Skip to main content

This site requires you to update your browser. Your browsing experience maybe affected by not having the most up to date version.

We're retiring the forums!

The SilverStripe forums have passed their heyday. They'll stick around, but will be read only. We'd encourage you to get involved in the community via the following channels instead:

General Questions /

General questions about getting started with SilverStripe that don't fit in any of the categories above.

Moderators: martimiz, Sean, Ed, biapar, Willr, Ingo, swaiba

What to put in robots.txt ?

Go to End



Community Member, 131 Posts

30 March 2009 at 7:56am

Edited: 30/03/2009 8:53am


What folders should be allowed in robots.txt to make sure the pages (/mypage/, /myblogpage/ etc) are still indexed by SE-bots (while everything else is blocked)?
In the forums there seem to be different opinions on this one.
Maybe there is someone who knows alot about SS who can shed some light on the topic?