remove duplicates words in a row from a column of a string text

[dhruvgulati]

input

hello [hello] demo

hi how/how are you

i love you-you

hi how are are you

output

hello demo

hi how are you

i love you

hi how are you

[v-yalanwu-msft]

Hi, @dhruvgulati ;

You could create a funtion.

= Table.AddColumn(#"Changed Type", "Custom", each 
Text.Combine(List.Distinct(Text.SplitAny([name], " -/[]"))," "))

The full M language.

let
    Source = Table.FromRows(Json.Document(Binary.Decompress(Binary.FromText("i45WykjNyclXiAZTsQopqbn5SrE6QOFMhYz8cn0gVkgsSlWozC8FC2cq5OSXgbm6MCGISrAquMpYAA==", BinaryEncoding.Base64), Compression.Deflate)), let _t = ((type nullable text) meta [Serialized.Text = true]) in type table [name = _t]),
    #"Changed Type" = Table.TransformColumnTypes(Source,{{"name", type text}}),
    Custom1 = Table.AddColumn(#"Changed Type", "Custom", each 
Text.Combine(List.Distinct(Text.SplitAny([name], " -/[]"))," "))
in
    Custom1

The final show:

Best Regards,
Community Support Team _ Yalan Wu
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[wdx223_Daniel · Accepted solution]

[AnkitKukreja]

Hi! @dhruvgulati 

For this, you might have to share sample rows. For this, you need to split the columns and then merge to as per your requirement.