Jump to:

21301 Posts in 5736 Topics by 2603 members

General Questions

SilverStripe Forums » General Questions » What to put in robots.txt ?

General questions about getting started with SilverStripe that don't fit in any of the categories above.

Moderators: martimiz, Howard, Sean, Ryan M., biapar, Willr, Ingo, swaiba, simon_w

Page: 1
Go to End
Author Topic: 840 Views
  • theAlien
    Avatar
    Community Member
    131 Posts

    What to put in robots.txt ? Link to this post

    30 March 2009 at 7:56am Last edited: 30 March 2009 8:53am

    Hi,

    What folders should be allowed in robots.txt to make sure the pages (/mypage/, /myblogpage/ etc) are still indexed by SE-bots (while everything else is blocked)?
    In the forums there seem to be different opinions on this one.
    Maybe there is someone who knows alot about SS who can shed some light on the topic?

    840 Views
Page: 1
Go to Top

Want to know more about the company that brought you SilverStripe? Then check out SilverStripe.com

Comments on this website? Please give feedback.