Jump to:

23380 Posts in 18311 Topics by 2867 members

General Questions

SilverStripe Forums » General Questions » What to put in robots.txt ?

General questions about getting started with SilverStripe that don't fit in any of the categories above.

Moderators: martimiz, Sean, biapar, Willr, Ingo, swaiba, simon_w

Page: 1
Go to End
Author Topic: 962 Views
  • theAlien
    Avatar
    Community Member
    131 Posts

    What to put in robots.txt ? Link to this post

    Hi,

    What folders should be allowed in robots.txt to make sure the pages (/mypage/, /myblogpage/ etc) are still indexed by SE-bots (while everything else is blocked)?
    In the forums there seem to be different opinions on this one.
    Maybe there is someone who knows alot about SS who can shed some light on the topic?

    962 Views
Page: 1
Go to Top

Want to know more about the company that brought you SilverStripe? Then check out SilverStripe.com

Comments on this website? Please give feedback.