22977 Posts in 11742 Topics by 2826 members
|Go to End|
30 March 2009 at 7:56am Last edited: 30 March 2009 8:53am
What folders should be allowed in robots.txt to make sure the pages (/mypage/, /myblogpage/ etc) are still indexed by SE-bots (while everything else is blocked)?
In the forums there seem to be different opinions on this one.
Maybe there is someone who knows alot about SS who can shed some light on the topic?
|Go to Top|