Skip to main content

This site requires you to update your browser. Your browsing experience maybe affected by not having the most up to date version.

General Questions /

General questions about getting started with SilverStripe that don't fit in any of the categories above.

Moderators: martimiz, Sean, biapar, Willr, Ingo, swaiba, simon_w

Googlebot Access


Reply


6 Posts   1355 Views

Avatar
eceers

Community Member, 24 Posts

4 May 2010 at 12:34am

I have a client need to be able to access secure pages by google so they can be found in google search results. I have created a bit of code that sniffs out the UserAgent to be Googlebot and if so display the page. When i test the process using the Firefox plugin "User Agent Switcher" I can browse the site as if I was Google. But when I put the pages up on the live server the pages are not being indexed.

I know its not Silverstripe specific any help would be greatly appreciated.

Thanks in advance.

Avatar
banal

Community Member, 901 Posts

4 May 2010 at 2:09am

Do they show up in your sitemap.xml?
How did you point the google indexer to these pages?

I suggest you use the google Webmaster tools if you aren't using that already.
http://www.google.com/webmasters/

Avatar
Hamish

Community Member, 712 Posts

4 May 2010 at 3:37pm

...I have a client need to be able to access secure pages by google...

You know that this means the content of those pages will be accessible via Google cached view, and anyone who modifies their user-agent strings, right?

Avatar
eceers

Community Member, 24 Posts

4 May 2010 at 4:56pm

thanks guys,

banal: I'll have a look and see what the go is. last time I tried looking at that file I got a server timeout error.

hamish: yep I know :(

Avatar
Hamish

Community Member, 712 Posts

4 May 2010 at 4:56pm

Edited: 04/05/2010 4:57pm

Heh, ah well, the client wants what the client wants.

Avatar
eceers

Community Member, 24 Posts

5 May 2010 at 10:48am

Now I have a new problem :(

when I try touching the sitemap.xml that is being auto-generated by SS i get this

XML Parsing Error: no element found
Location: http://localhost/nishnish/energyview.dev/sitemap.xml
Line Number 1, Column 1:

What am I doing wrong now :(