Skip to main content

This site requires you to update your browser. Your browsing experience maybe affected by not having the most up to date version.

General Questions /

General questions about getting started with SilverStripe that don't fit in any of the categories above.

Moderators: martimiz, Sean, biapar, Willr, Ingo, swaiba, simon_w

Huge Duplicate URLs SEO problem impacting our sites


Reply


3 Posts   848 Views

Avatar
lozhowlett

Community Member, 146 Posts

14 February 2013 at 11:46pm

Hi Everyone

We recently launched www.safari.co.uk on the SS3 framework, thinking this would be an improvement, however there are HUGE SEO PROBLEMS!

Duplicate URLs

framework/main.php?url=kenya
sapphire/main.php?url=kenya
/kenya
kenya/

Are all the same! Now we have excluded the top 2 with a robots.text, but the / is a problem. SS3 rewrites links to have a / at the end, thats fine, but why doesnt it rewrite non-slashes to slashes? This is causing instant drop in SERPs, overnight from launching the site. Duplication radar is going mental!

We have tried lots of htaccess rules, with no sucess...

RewriteCond %{REQUEST_URI} !(.*)/$
RewriteRule ^(.*)$ http://www.safarilocal.co.uk/$1/ [R=301]

RewriteCond %{REQUEST_URI} !^blog/(.*)$
   RewriteCond %{REQUEST_URI} ^(.*)$
   RewriteCond %{REQUEST_FILENAME} !-f
   RewriteRule .* framework/main.php?url=%1&%{QUERY_STRING} [L]

There doesnt seem to be something that will play nice with forms, admin and pages that rewrites everything to have a / at the end. We need to consider dataobjects as pages, form posts, etc in the htaccess.

Please help!

Thanks

Avatar
Willr

Forum Moderator, 5513 Posts

16 February 2013 at 4:28pm

Not sure if this is fixed in 3.1 (I recall a discussion about it) but I have a patch for 2.4 which I used on production sites - http://open.silverstripe.org/ticket/6700

Avatar
simon_w

Forum Moderator, 474 Posts

16 February 2013 at 6:44pm

Also, have a look at putting in a [url=http://support.google.com/webmasters/bin/answer.py?hl=en&answer=139394]rel=canonical[/url] link tag. Something like <link rel="canonical" href="$AbsoluteLink" /> should work for any Page.