Skip to main content

This site requires you to update your browser. Your browsing experience maybe affected by not having the most up to date version.

General Questions

General questions about getting started with SilverStripe that don't fit in any of the categories above.

Moderators: martimiz, Sean, biapar, Willr, Ingo, swaiba, simon_w

how do I stop GET/page from showing in Google


Reply

5 Posts   2663 Views

Avatar
Daimz

15 February 2010 at 8:03pm Community Member, 36 Posts

I am having some trouble finding out how to stop all my folders showing in google. If I type in site:arctosdesign.com I will see hundreds of pages that say GET/folder/folder and I have been wrned that not removing these pages from google might end up hurting my SEO. Why is Silverstripe showing these pages and how should I go about only showing my actual Website pages?

Thanx I really am a bit puzzeled and could use some help.

Avatar
Sean

15 February 2010 at 8:24pm (Last edited: 15 February 2010 8:28pm), Forum Moderator, 921 Posts

Could you explain how you've setup SilverStripe on the production server. For example, accessing /silverstripe shouldn't be possible, but it looks like it allows it to happen anyway. May be the way the rewrite rules are working, or the way the virtual host is setup.

Also I suggest you change the URLs of http://www.arctosdesign.com/15/ http://www.arctosdesign.com/16/ and so on to be more descriptive, even /recent/15 would be good enough, as the user knows what to expect. I assume those entries are DataObjects, not actual pages in the CMS so you can't just pop the URLSegment in there instead of the ID.

Sean

Avatar
Daimz

15 February 2010 at 8:39pm Community Member, 36 Posts

Well I have basily set it up so that I dont have a silverstrip folder. So what I mean is the assets, mysite and Saphire folders etc are all stored at in Public_html on my server. I don't know if this is right or not but I did it because I read somewhere that it was how I should set it up. Am I right here? Any ideas I was not to sure on what exactly you were meaning.

Also I set my portfolio up so that each Item is a page so I should be able to change the names like you suggest.

Avatar
Daimz

16 February 2010 at 2:13pm Community Member, 36 Posts

Any more ideas?

Avatar
banal

16 February 2010 at 8:37pm Community Member, 901 Posts

I think it's google that has some old search records. Maybe tweak your robots.txt file (http://www.robotstxt.org/) and/or login to google webmaster tools (http://www.google.com/webmasters/). There you can create requests for removal of pages and also point google to your sitemap.xml (http://www.arctosdesign.com/sitemap.xml). This will help google to keep their index up to date.

Also important: There seems to be something wrong with your 404 page. If I enter a non-existant URL like: http://www.arctosdesign.com/testing I get a SilverStripe error and not a 404 error. The status of this page is 200 though, which means OK, therefore there's no need for google to remove such a page from its index.