Jump to:

1133 Posts in 1966 Topics by 403 members

Upgrading SilverStripe

SilverStripe Forums » Upgrading SilverStripe » UTF-8 characters mangled after migration from 3.0.0 to 3.1.2

Ask questions about upgrading SilverStripe to the latest version.

Moderators: martimiz, Sean, biapar, Willr, Ingo, swaiba, simon_w

Page: 1
Go to End
Author Topic: 168 Views
  • deadlyllama
    Avatar
    Community Member
    4 Posts

    UTF-8 characters mangled after migration from 3.0.0 to 3.1.2 Link to this post

    I'm trying to migrate a site from SilverStripe CMS v3.0.0 to v3.1.2.

    So far I've untarred the new version, copied over themes and assets, copied mysite/_config.php and symlinked "__mysite" to "mysite" which the new version seems to need. And the site renders fine apart from all the utf-8 characters appearing to be double-encoded.

    The site has a few pages (and page titles) in Korean, and a bunch of non-ASCII characters strewn through the English text. Prior to the upgrade, these rendered fine. I've tested upgrading to 3.0.5 and they still render OK. (3.0.6+ had some odd issues with producing invalid XML).

    With 3.1.2, I see spurious "Â" characters in the text, and the page formerly titled "한국어" is now titled " 한국어". And other non-ASCII characters are similarly odd.

    The document header includes
    <meta http-equiv="Content-type" content="text/html; charset=utf-8" >

    and my browser says it's displaying the page as UTF-8 (in fact, it won't let me select anything else). This was true of the old version of the site, too.

    What's going wrong?

  • deadlyllama
    Avatar
    Community Member
    4 Posts

    Re: UTF-8 characters mangled after migration from 3.0.0 to 3.1.2 Link to this post

    Problem solved. Looked at a hex dump of my database dump and found a bunch of double-encoded UTF-8. Tried several methods of fixing this, but the only one that worked was a fix in situ, http://www.noelboss.com/2011/11/fixing-double-encoded-utf-8-data-in-mysql/

    168 Views
Page: 1
Go to Top

Want to know more about the company that brought you SilverStripe? Then check out SilverStripe.com

Comments on this website? Please give feedback.