22427 Posts in 6976 Topics by 2750 members
|Go to End|
30 March 2009 at 7:56am Last edited: 30 March 2009 8:53am
What folders should be allowed in robots.txt to make sure the pages (/mypage/, /myblogpage/ etc) are still indexed by SE-bots (while everything else is blocked)?
In the forums there seem to be different opinions on this one.
Maybe there is someone who knows alot about SS who can shed some light on the topic?
|Go to Top|