Comments on: Ultimate solution to weird UTF character encoding problem http://www.prelovac.com/vladimir/ultimate-solution-to-weird-utf-character-encoding-problem Web 2.0, Marketing, Analytics, WordPress SEO Sat, 21 Nov 2009 03:18:41 -0600 hourly 1 By: Vladimirhttp://www.prelovac.com/vladimir/ultimate-solution-to-weird-utf-character-encoding-problem/comment-page-1#comment-16308 Vladimir http://www.prelovac.com/vladimir/?p=814#comment-16308 I can only suggest you try it out - it won't hurt I can only suggest you try it out - it won't hurt

]]> By: Ploeterhttp://www.prelovac.com/vladimir/ultimate-solution-to-weird-utf-character-encoding-problem/comment-page-1#comment-16271 Ploeter http://www.prelovac.com/vladimir/?p=814#comment-16271 Hello Vladimir,In many topics on our site we have a problem with character sets. However, in new written topics there's no problem at all. This might prove that our database is set correctly. We had a database crash last week (caused by a ' nice ' security-plugin) and had to import a backup. But from that moment strange characters, like FFFD-icons appeared on our site.Example with FFFD-icons (this is Dutch ;)) �We kwamen uit de informatiebesprekingen. Bos en Balkenende zeiden tegen mij: �Jan, ga jij maar als eerste naar buiten�. If a word contains an accent and placed between quote signs, for instance: "Héllo!", this word appears as: Hllo .Is your Modified UTF8-Sanitize Plugin worthfull for us?By the way: since we are operating with a new theme (OneRoom) search engines are no longer able to find us, despite our site ( detelegravin.nl ) is indexed by Google. Hopefully you can help with this problem too. If so, I will put a 125 px by 170 px banner of your book on the frontpage of the site. Hello Vladimir,

In many topics on our site we have a problem with character sets. However, in new written topics there's no problem at all. This might prove that our database is set correctly.
We had a database crash last week (caused by a ' nice ' security-plugin) and had to import a backup. But from that moment strange characters, like FFFD-icons appeared on our site.

Example with FFFD-icons (this is Dutch ;))
�We kwamen uit de informatiebesprekingen. Bos en Balkenende zeiden tegen mij: �Jan, ga jij maar als eerste naar buiten�.
If a word contains an accent and placed between quote signs, for instance: "Héllo!", this word appears as: Hllo .

Is your Modified UTF8-Sanitize Plugin worthfull for us?

By the way: since we are operating with a new theme (OneRoom) search engines are no longer able to find us, despite our site ( detelegravin.nl ) is indexed by Google.
Hopefully you can help with this problem too. If so, I will put a 125 px by 170 px banner of your book on the frontpage of the site.

]]> By: Shawn Swansonhttp://www.prelovac.com/vladimir/ultimate-solution-to-weird-utf-character-encoding-problem/comment-page-1#comment-16174 Shawn Swanson http://www.prelovac.com/vladimir/?p=814#comment-16174 Thanks for this plugin. I tried everything and this saved me a bunch of time. You are my hero. Thanks for this plugin. I tried everything and this saved me a bunch of time. You are my hero.

]]> By: Vladimirhttp://www.prelovac.com/vladimir/ultimate-solution-to-weird-utf-character-encoding-problem/comment-page-1#comment-15364 Vladimir http://www.prelovac.com/vladimir/?p=814#comment-15364 You are welcome :) You are welcome :)

]]> By: Miguel A Manriquehttp://www.prelovac.com/vladimir/ultimate-solution-to-weird-utf-character-encoding-problem/comment-page-1#comment-15361 Miguel A Manrique http://www.prelovac.com/vladimir/?p=814#comment-15361 Great Post, i dindt worked in my site your marvellous plugin, but i great to you for the tip: "plugin called bbWP2UTF8, that will try the conversion to UTF charset." This plugin, it be working correct! Many Thanks Vladimir! Many month with several blog with problem, and i just fix with your help! Great Post, i dindt worked in my site your marvellous plugin, but i great to you for the tip: "plugin called bbWP2UTF8, that will try the conversion to UTF charset." This plugin, it be working correct! Many Thanks Vladimir! Many month with several blog with problem, and i just fix with your help!

]]> By: ErnestoJustiniano.orghttp://www.prelovac.com/vladimir/ultimate-solution-to-weird-utf-character-encoding-problem/comment-page-1#comment-14541 ErnestoJustiniano.org http://www.prelovac.com/vladimir/?p=814#comment-14541 ok, i will try to explain in spanglish my problem: 1) when i post to wordpress inside wordpress (mean from the administrator) any accented letter is an accented letter. example: á is á, ¿ is ¿ ...and so. [write so in database] 2) when i post using windows live writer an á is á - ¿ is &iquest, this i can see when i go to edit the article. [write acute, rdaquo, iquest... in database] 3) both 1 and 2 shows correct in browser. but not when i edit the article. so my database can have titles with condition 1 or 2. 4) the interesting thing is that happens only with the title of the article. the content for both 1 and 2 is correctly written. 5) i did notice it because my post goes to twitter (shows correct) and then goes to facebook (shows incorrect with acute, iquest, rdaquo ...) 6) i have checked my database tables. wordpress tables are utf8_general, collate for all the database is latin. yesterday i did make a new database with tables utf8 and collate utf8 and the problems persist. so, it is not a question of database format. 7) i did deactivate all plugins and the problem persist... 8) information from my new dedicated server people: I have enabled suPHP. I have also installed the latest version of PHP (5.2.10) and libXML (2.7.3), provided by cPanel. 9) i have tried changing my theme and the problem persist..Now what can i do to resolve this? I will appreciat a lot your answer. TY ok, i will try to explain in spanglish my problem:
1) when i post to wordpress inside wordpress (mean from the administrator) any accented letter is an accented letter. example: á is á, ¿ is ¿ ...and so. [write so in database]
2) when i post using windows live writer an á is á - ¿ is &iquest, this i can see when i go to edit the article. [write acute, rdaquo, iquest... in database]
3) both 1 and 2 shows correct in browser. but not when i edit the article. so my database can have titles with condition 1 or 2.
4) the interesting thing is that happens only with the title of the article. the content for both 1 and 2 is correctly written.
5) i did notice it because my post goes to twitter (shows correct) and then goes to facebook (shows incorrect with acute, iquest, rdaquo ...)
6) i have checked my database tables. wordpress tables are utf8_general, collate for all the database is latin. yesterday i did make a new database with tables utf8 and collate utf8 and the problems persist. so, it is not a question of database format.
7) i did deactivate all plugins and the problem persist...
8) information from my new dedicated server people: I have enabled suPHP. I have also installed the latest version of PHP (5.2.10) and libXML (2.7.3), provided by cPanel.
9) i have tried changing my theme and the problem persist..

Now what can i do to resolve this? I will appreciat a lot your answer. TY

]]> By: David Mahttp://www.prelovac.com/vladimir/ultimate-solution-to-weird-utf-character-encoding-problem/comment-page-1#comment-14003 David Ma http://www.prelovac.com/vladimir/?p=814#comment-14003 Just wanted to say thanks for the excellent plugin! Worked like a charm and saved me quite a bit of time and frustration. Most appreciated. Just wanted to say thanks for the excellent plugin! Worked like a charm and saved me quite a bit of time and frustration. Most appreciated.

]]> By: Vladimirhttp://www.prelovac.com/vladimir/ultimate-solution-to-weird-utf-character-encoding-problem/comment-page-1#comment-13982 Vladimir http://www.prelovac.com/vladimir/?p=814#comment-13982 You are welcome, it's amazing to save :) You are welcome, it's amazing to save :)

]]> By: Sparkybarkalothttp://www.prelovac.com/vladimir/ultimate-solution-to-weird-utf-character-encoding-problem/comment-page-1#comment-13981 Sparkybarkalot http://www.prelovac.com/vladimir/?p=814#comment-13981 Vladimir, thank you very, very much for your work on this. Thorsten's excellent recommendation would have helped me AVOID this problem, but since I was already HAVING the problem and couldn't go back, your modified plugin saved. None of my other attempts (MySQL search and replace, for example) worked and you saved me!!! Vladimir, thank you very, very much for your work on this. Thorsten's excellent recommendation would have helped me AVOID this problem, but since I was already HAVING the problem and couldn't go back, your modified plugin saved. None of my other attempts (MySQL search and replace, for example) worked and you saved me!!!

]]> By: Thorsten Albrechthttp://www.prelovac.com/vladimir/ultimate-solution-to-weird-utf-character-encoding-problem/comment-page-1#comment-13854 Thorsten Albrecht http://www.prelovac.com/vladimir/?p=814#comment-13854 The background, why those characters appear ("you may encounter problem with strange characters (like —) appearing in your WordPress posts") has a simple solution: Characters, that are encoded as UTF8 in a database are somehow being "reencoded" to UTF8.This happens, for example, if you transfer a MySql 4.0 database, which is set to latin1 but contains data from Wordpress in UTF8(!), to a MySQL5 database. The dump (generated with mysqldump) contains the correct UTF8 encoded characters, but the import uses the wrong client connection (latin1) because no information of the UTF8 characters are found in the dump. In the import process the dump is beeing converted to UTF8 again - and you get the weired characters.Solution: Tell the import process to use the right client connection, i.e. UTF8. This is made with the statement SET NAMES UTF-8, or in the mysqldump file: insert at the beginning. /*!40101 SET NAMES utf8 */;No obscure Wordpress plugins are beeing needed, e.g. UTF8-Sanitize Plugin.Thorsten The background, why those characters appear ("you may encounter problem with strange characters (like —) appearing in your WordPress posts") has a simple solution: Characters, that are encoded as UTF8 in a database are somehow being "reencoded" to UTF8.

This happens, for example, if you transfer a MySql 4.0 database, which is set to latin1 but contains data from Wordpress in UTF8(!), to a MySQL5 database. The dump (generated with mysqldump) contains the correct UTF8 encoded characters, but the import uses the wrong client connection (latin1) because no information of the UTF8 characters are found in the dump. In the import process the dump is beeing converted to UTF8 again - and you get the weired characters.

Solution: Tell the import process to use the right client connection, i.e. UTF8. This is made with the statement SET NAMES UTF-8, or in the mysqldump file: insert at the beginning.
/*!40101 SET NAMES utf8 */;

No obscure Wordpress plugins are beeing needed, e.g. UTF8-Sanitize Plugin.

Thorsten

]]> By: The Switch to UTF-8 Causes Character Encoding Errors for Some Wordpress Blogs | The 42nd Estatehttp://www.prelovac.com/vladimir/ultimate-solution-to-weird-utf-character-encoding-problem/comment-page-1#comment-12831 The Switch to UTF-8 Causes Character Encoding Errors for Some Wordpress Blogs | The 42nd Estate http://www.prelovac.com/vladimir/?p=814#comment-12831 [...] can even schedule it to run automatically once a day for no hassle backups. Second, download the modified version of the UTF-8 Sanitize plugin. This modified plugin will go through your database, find these odd characters and replace them [...] [...] can even schedule it to run automatically once a day for no hassle backups. Second, download the modified version of the UTF-8 Sanitize plugin. This modified plugin will go through your database, find these odd characters and replace them [...]

]]> By: Joelhttp://www.prelovac.com/vladimir/ultimate-solution-to-weird-utf-character-encoding-problem/comment-page-1#comment-11940 Joel http://www.prelovac.com/vladimir/?p=814#comment-11940 You're a genuis!! You saved my day. The original plugin didn't work, this worked like a charm :) You're a genuis!!
You saved my day. The original plugin didn't work, this worked like a charm :)

]]> By: blog.looseends.net » Dissecting a WordPress Blog Crashhttp://www.prelovac.com/vladimir/ultimate-solution-to-weird-utf-character-encoding-problem/comment-page-1#comment-10641 blog.looseends.net » Dissecting a WordPress Blog Crash http://www.prelovac.com/vladimir/?p=814#comment-10641 [...] Ultimate Solution to weird UTF character encoding problem [...] [...] Ultimate Solution to weird UTF character encoding problem [...]

]]> By: lmhttp://www.prelovac.com/vladimir/ultimate-solution-to-weird-utf-character-encoding-problem/comment-page-1#comment-10571 lm http://www.prelovac.com/vladimir/?p=814#comment-10571 awesome worked for me thanks awesome worked for me
thanks

]]> By: Chasing Daydreams » Weird Characters In WordPress Postshttp://www.prelovac.com/vladimir/ultimate-solution-to-weird-utf-character-encoding-problem/comment-page-1#comment-10429 Chasing Daydreams » Weird Characters In WordPress Posts http://www.prelovac.com/vladimir/?p=814#comment-10429 [...] The first solution I saw is a little bit unsatisfactory so I searched some more and found the ultimate solution. I followed the instructions and, voila!, no more weird characters. var addthis_pub = [...] [...] The first solution I saw is a little bit unsatisfactory so I searched some more and found the ultimate solution. I followed the instructions and, voila!, no more weird characters. var addthis_pub = [...]

]]>