Forum Discussion

Mimi_Ibrahim's avatar
Mimi_Ibrahim
Helper I
6 years ago
Solved

How to identify Chinese Characters in Name Field

Hello,    I need help to identify Chinese character in the 'Name' field. Can someone help? Example of the expected values are below. Thank you.   Name Chinese Char? Chong, Mei Li (é©° 馳) Ye...
Need Help
  • dax's avatar
    dax
    6 years ago

    Hi Mimi_Ibrahim , 

    You could try below M code to see whether it work or not

     

    let
    Source = Table.FromRows(Json.Document(Binary.Decompress(Binary.FromText("i45Wcs7Iz0vXUfBNzVTwyVTQeLlyg8LLZZs1lWJ1opUcc1IrdBRCEvMUNJ5N2/ts4wKIMFRLAFBLZCZYxCczLyVRR8E/H8iNBQA=", BinaryEncoding.Base64), Compression.Deflate)), let _t = ((type text) meta [Serialized.Text = true]) in type table [Column1 = _t]),
    #"Changed Type1" = Table.TransformColumnTypes(Source,{{"Column1", type text}}),
    #"Added Custom" = Table.AddColumn(#"Changed Type1", "Custom", each if Text.Remove([Column1],List.Transform({0..127}, each Character.FromNumber(_)))="" then "No" else "Yes")
in
    #"Added Custom"

     

    You could refer to https://www.asciitable.com/  for details.

    Best Regards,
    Zoe Zhi

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

     

dax's avatar
dax
Community Support
6 years ago

Hi Mimi_Ibrahim , 

You could try below M code to see whether it work or not

 

let
    Source = Table.FromRows(Json.Document(Binary.Decompress(Binary.FromText("i45Wcs7Iz0vXUfBNzVTwyVTQeLlyg8LLZZs1lWJ1opUcc1IrdBRCEvMUNJ5N2/ts4wKIMFRLAFBLZCZYxCczLyVRR8E/H8iNBQA=", BinaryEncoding.Base64), Compression.Deflate)), let _t = ((type text) meta [Serialized.Text = true]) in type table [Column1 = _t]),
    #"Changed Type1" = Table.TransformColumnTypes(Source,{{"Column1", type text}}),
    #"Added Custom" = Table.AddColumn(#"Changed Type1", "Custom", each if Text.Remove([Column1],List.Transform({0..127}, each Character.FromNumber(_)))="" then "No" else "Yes")
in
    #"Added Custom"

 

You could refer to https://www.asciitable.com/  for details.

Best Regards,
Zoe Zhi

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

 

  • Mimi_Ibrahim's avatar
    Mimi_Ibrahim
    Helper I
    6 years ago

    Hi Zoe Zhi, 

     

    It works like a charm! Can you explain how the code works please? Many thanks for your help 🙂

    • Mimi_Ibrahim's avatar
      Mimi_Ibrahim
      Helper I
      6 years ago

      I really want to know why you use Text.Remove. Before this I've been using Text.Contains which didnt work. 

       Text.Remove([Column1],List.Transform({0..127}, each Character.FromNumber(_)))=""
      • dax's avatar
        dax
        Community Support
        6 years ago

        Hi Mimi_Ibrahim , 

        This might be related to variable's type, text.contains seem to be text, but text.remove seems to be any. You could refer to text-contains  for details.

        By the way, List.Transform({0..127}, each Character.FromNumber(_))="" is used to list all chars , then you could use remove to remove characters from this list.

        Best Regards,
        Zoe Zhi

        If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.