Jump to:

23456 Posts in 18905 Topics by 2877 members

General Questions

SilverStripe Forums » General Questions » What to put in robots.txt ?

General questions about getting started with SilverStripe that don't fit in any of the categories above.

Moderators: martimiz, Sean, biapar, Willr, Ingo, swaiba, simon_w

Page: 1
Go to End
Author Topic: 968 Views
  • theAlien
    Community Member
    131 Posts

    What to put in robots.txt ? Link to this post


    What folders should be allowed in robots.txt to make sure the pages (/mypage/, /myblogpage/ etc) are still indexed by SE-bots (while everything else is blocked)?
    In the forums there seem to be different opinions on this one.
    Maybe there is someone who knows alot about SS who can shed some light on the topic?

Page: 1
Go to Top

Want to know more about the company that brought you SilverStripe? Then check out SilverStripe.com

Comments on this website? Please give feedback.