17 February 2009 at 6:10am
(Last edited: 17 February 2009 6:11am),
I used auditmypc.com sitemap generator, and i saw that assets and theme folder is getting into sitemap,
So, i added robots.txt
Almost all the cms are coming with robots.txt file after the install is finished. Could SS do the same ?
And, 2nd, will be bad for search engine indexing if i put in robot.txt
Or, should i ask what folder from SS would not go under Disallow