Display / Import Mixed Character Set

[Anonymous]

Hi all,

I'm trying to display some Twitter data that I've pulled off a MySQL server. The tweets include not only the 'standard' Western Latin character set, but also Russian cyrillic, Arabic and, just to confound things, emojis too!

When I pull these into PowerBI they coming out looking something this: ðŸ‡¨ðŸ‡·ðŸ†šðŸ‡®ðŸ‡· (I believe this is a flag emoji!)

Having looked at the data in MySQL I can see that the character sets are encoded correctly and the issue only occurs when I pull it into PowerBI.

Can anyone suggest how I might fix this problem?

TIA,

SamB

[Anonymous]

In short, adding code below in red blod in your advance editor and blame MS for their casual document.

MySQL.Database("10.181.165.202", "pobot", [ReturnSingleDatabase=true, Encoding=TextEncoding.Utf8])

In addition, the available encoding are

  TextEncoding.Utf8, TextEncoding.Utf16, TextEncoding.Ascii, TextEncoding.Unicode, TextEncoding.BigEndianUnicode, TextEncoding.Windows

[Greg_Deckler]

Check out the Text.Encoding functions in Power Query:

https://msdn.microsoft.com/en-us/library/mt826838.aspx

[Anonymous]

Hi smoupre,

Thanks for the reply. I'm pretty new to PowerBI - how would I apply these functions to a column, and which one would I use - the help pages don't have a lot of info!

Thanks,

Sam

[Greg_Deckler · Accepted solution]

You'd have to do it in the Advanced Editor and the documentation on those functions is really lacking. Perhaps @ImkeF or @MarcelBeug might have some insight into the proper use of those functions. Here is another article that I found that might help. It doesn't use those functions but changes the encoding type on import:

https://social.technet.microsoft.com/Forums/en-US/7b29d033-6230-4fa0-aafc-8313ea771f24/change-encodi...

[Anonymous]

Ah, OK - thanks for links and assists @Greg_Deckler - much appreciated!

[anuradharao]

Hello @Greg_Deckler, @Anonymous

I am also facing the similar problem.

The imported data from database is showing me some special characters as explained in the first post.

I am not able to understand how I can set character set to utf8 for this column of table in Advance query option.

Kindly help.