Jump to:

23368 Posts in 18143 Topics by 2863 members

General Questions

SilverStripe Forums » General Questions » Googlebot Access

General questions about getting started with SilverStripe that don't fit in any of the categories above.

Moderators: martimiz, Sean, biapar, Willr, Ingo, swaiba, simon_w

Page: 1
Go to End
Author Topic: 1251 Views
  • eceers
    Avatar
    Community Member
    24 Posts

    Googlebot Access Link to this post

    I have a client need to be able to access secure pages by google so they can be found in google search results. I have created a bit of code that sniffs out the UserAgent to be Googlebot and if so display the page. When i test the process using the Firefox plugin "User Agent Switcher" I can browse the site as if I was Google. But when I put the pages up on the live server the pages are not being indexed.

    I know its not Silverstripe specific any help would be greatly appreciated.

    Thanks in advance.

  • banal
    Avatar
    Community Member
    901 Posts

    Re: Googlebot Access Link to this post

    Do they show up in your sitemap.xml?
    How did you point the google indexer to these pages?

    I suggest you use the google Webmaster tools if you aren't using that already.
    http://www.google.com/webmasters/

  • Hamish
    Avatar
    Community Member
    712 Posts

    Re: Googlebot Access Link to this post

    ...I have a client need to be able to access secure pages by google...

    You know that this means the content of those pages will be accessible via Google cached view, and anyone who modifies their user-agent strings, right?

  • eceers
    Avatar
    Community Member
    24 Posts

    Re: Googlebot Access Link to this post

    thanks guys,

    banal: I'll have a look and see what the go is. last time I tried looking at that file I got a server timeout error.

    hamish: yep I know

  • Hamish
    Avatar
    Community Member
    712 Posts

    Re: Googlebot Access Link to this post

    Heh, ah well, the client wants what the client wants.

  • eceers
    Avatar
    Community Member
    24 Posts

    Re: Googlebot Access Link to this post

    Now I have a new problem

    when I try touching the sitemap.xml that is being auto-generated by SS i get this

    XML Parsing Error: no element found
    Location: http://localhost/nishnish/energyview.dev/sitemap.xml
    Line Number 1, Column 1:

    What am I doing wrong now

    1251 Views
Page: 1
Go to Top

Want to know more about the company that brought you SilverStripe? Then check out SilverStripe.com

Comments on this website? Please give feedback.