15 February 2010 at 8:03pm
I am having some trouble finding out how to stop all my folders showing in google. If I type in site:arctosdesign.com I will see hundreds of pages that say GET/folder/folder and I have been wrned that not removing these pages from google might end up hurting my SEO. Why is Silverstripe showing these pages and how should I go about only showing my actual Website pages?
Thanx I really am a bit puzzeled and could use some help.
15 February 2010 at 8:24pm
(Last edited: 15 February 2010 8:28pm),
Could you explain how you've setup SilverStripe on the production server. For example, accessing /silverstripe shouldn't be possible, but it looks like it allows it to happen anyway. May be the way the rewrite rules are working, or the way the virtual host is setup.
Also I suggest you change the URLs of http://www.arctosdesign.com/15/ http://www.arctosdesign.com/16/ and so on to be more descriptive, even /recent/15 would be good enough, as the user knows what to expect. I assume those entries are DataObjects, not actual pages in the CMS so you can't just pop the URLSegment in there instead of the ID.
15 February 2010 at 8:39pm
Well I have basily set it up so that I dont have a silverstrip folder. So what I mean is the assets, mysite and Saphire folders etc are all stored at in Public_html on my server. I don't know if this is right or not but I did it because I read somewhere that it was how I should set it up. Am I right here? Any ideas I was not to sure on what exactly you were meaning.
Also I set my portfolio up so that each Item is a page so I should be able to change the names like you suggest.
16 February 2010 at 8:37pm
I think it's google that has some old search records. Maybe tweak your robots.txt file (http://www.robotstxt.org/) and/or login to google webmaster tools (http://www.google.com/webmasters/). There you can create requests for removal of pages and also point google to your sitemap.xml (http://www.arctosdesign.com/sitemap.xml). This will help google to keep their index up to date.
Also important: There seems to be something wrong with your 404 page. If I enter a non-existant URL like: http://www.arctosdesign.com/testing I get a SilverStripe error and not a 404 error. The status of this page is 200 though, which means OK, therefore there's no need for google to remove such a page from its index.