I have a client need to be able to access secure pages by google so they can be found in google search results. I have created a bit of code that sniffs out the UserAgent to be Googlebot and if so display the page. When i test the process using the Firefox plugin "User Agent Switcher" I can browse the site as if I was Google. But when I put the pages up on the live server the pages are not being indexed.

I know its not Silverstripe specific any help would be greatly appreciated.

Thanks in advance.

Do they show up in your sitemap.xml?
How did you point the google indexer to these pages?

I suggest you use the google Webmaster tools if you aren't using that already.
http://www.google.com/webmasters/

...I have a client need to be able to access secure pages by google...

You know that this means the content of those pages will be accessible via Google cached view, and anyone who modifies their user-agent strings, right?

thanks guys,

banal: I'll have a look and see what the go is. last time I tried looking at that file I got a server timeout error.

hamish: yep I know :(

Heh, ah well, the client wants what the client wants.

Now I have a new problem :(

when I try touching the sitemap.xml that is being auto-generated by SS i get this

XML Parsing Error: no element found
Location: http://localhost/nishnish/energyview.dev/sitemap.xml
Line Number 1, Column 1:

What am I doing wrong now :(