Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

The Power BI Data Visualization World Championships is back! Get ahead of the game and start preparing now! Learn more

Reply
Jasmin00
New Member

Please help me to filter out special characters in my column to another column

My current data looks like this and I need to clean it. It is filled with special characters that I do not know how to replace universally and also has alternative languages that need to be altered. Is there any Power BI function for this? Please help!! 

Series_Title

Il buono, il brutto, il cattivo
Batman Begins
The Lord of the Rings: The Two Towers
Dunkirk
The Matrix
Goodfellas
Network
Star Wars: Episode V - The Empire Strikes Back
Dog Day Afternoon
One Flew Over the Cuckoo's Nest
The Verdict
Gisaengchung
Soorarai Pottru
Cidade de Deus
The Hobbit: The Desolation of Smaug
Sen to Chihiro no kamikakushi
The Hobbit: An Unexpected Journey
Saving Private Ryan
Django Unchained
La vita è bella
Inglourious Basterds
Se7en
Reservoir Dogs
The Silence of the Lambs
Kill Bill: Vol. 1
Star Wars
Kill Bill: Vol. 2
Seppuku
American History X
E.T. the Extra-Terrestrial
Léon
Bridge of Spies
Terminator 2: Judgment Day
Close Encounters of the Third Kind
Nuovo Cinema Paradiso
Hotaru no haka
Back to the Future
Gone Girl
Casablanca
The Game
Modern Times
The Social Network
City Lights
Zodiac
Capharnaüm
Ayla: The Daughter of War
Vikram Vedha
Cast Away
Kimi no na wa.
Back to the Future Part II
Dangal
Who Framed Roger Rabbit
Per qualche dollaro in più
Per un pugno di dollari
Giù la testa
3 Idiots
Taare Zameen Par
WALL·E
True Grit
Hauru no ugoku shiro
Incendies
Tonari no Totoro
Miracle in cell NO.7
Kaze no tani no Naushika
Babam ve Oglum
Tenkû no shiro Rapyuta
Majo no takkyûbin
Eternal Sunshine of the Spotless Mind
Gake no ue no Ponyo
Amélie
Kurenai no buta
Requiem for a Dream
Rupan sansei: Kariosutoro no shiro
Bacheha-Ye aseman
Philadelphia
Toy Story
Braveheart
Full Metal Jacket
Ikiru
Idi i smotri
Ran
Aliens
Yôjinbô
Rashômon
Scarface
Kumonosu-jô
Kagemusha
The Sting
The Hangover
North by Northwest
Vertigo
La La Land
Singin' in the Rain
Ladri di biciclette
Citizen Kane
Le locataire
M - Eine Stadt sucht einen Mörder
Repulsion
The Kid
Chhichhore
Blade Runner
Uri: The Surgical Strike
The Martian
K.G.F: Chapter 1
American Gangster
Green Book
Black Hawk Down
Three Billboards Outside Ebbing, Missouri
Talvar
Detachment
Baahubali 2: The Conclusion
Klaus
Bohemian Rhapsody
Drishyam
X-Men: Days of Future Past
Queen
Mandariinid
The Fifth Element
Bhaag Milkha Bhaag
Gangs of Wasseypur
Udaan
Paan Singh Tomar
The Terminator
El secreto de sus ojos
Avatar
Warrior
Titanic
Up
La leggenda del pianista sull'oceano
La migliore offerta
Chak De! India
There Will Be Blood
Kaguyahime no monogatari
Pan's Labyrinth
Omohide poro poro
Toy Story 3
V for Vendetta
Rang De Basanti
Black
Dial M for Murder
Swades: We, the People
Rebecca
Der Untergang
Rope
Strangers on a Train
A Beautiful Mind
Notorious
Hera Pheri
Shadow of a Doubt
The Lady Vanishes
L.A. Confidential
The Birds
Eskiya
Heat
The Adventures of Robin Hood
Andaz Apna Apna
Unforgiven
Dom za vesanje
The Gold Rush
Die Hard
The Circus
Stalker
Höstsonaten
The Message
4 REPLIES 4
Anonymous
Not applicable

Like I said, this will get you most of the way there:

 

let
Source = YourTableName,
#"Changed Type" = Table.TransformColumnTypes(Source,{{"Series_Title", type text}}),
#"Added Custom" = Table.AddColumn(#"Changed Type", "Custom", each Text.ToList([Series_Title])),
#"Added Custom1" = Table.AddColumn(#"Added Custom", "Custom.1", each List.Transform([Custom], Character.ToNumber)),
#"Added Custom2" = Table.AddColumn(#"Added Custom1", "Custom.2", each Binary.FromList([Custom.1])),
#"Added Custom3" = Table.AddColumn(#"Added Custom2", "Custom.3", each Text.FromBinary([Custom.2]), type text)
in
#"Added Custom3"

 

watkinnc_0-1705721534575.png

 

--Nate

Hey Nate, thank you so so much for looking into this. I still don't really understand the full steps. what are suppose to be in the custom columns? Do i have to create a list of valid names first? because i dont have it.. and the full data set is 1000 columns. To make a clean data set, i would have to manually filter through all the rows, which is what i am trying to avoid doing... 

edhans
Super User
Super User

No. The problem is those aren't invalid characters, so Text.Clean() will do nothing. And what is worse, some that look wrong are not. Se7en is correct, not Seven, for example.

You probably need to look at replacing specific characters like the ¶ char with P or whatever it was supposed to be, or create a list of valid names then use the Fuzzy Match within a merge that will help you get around this.

edhans_0-1705708923946.png

 

 



Did I answer your question? Mark my post as a solution!
Did my answers help arrive at a solution? Give it a kudos by clicking the Thumbs Up!

DAX is for Analysis. Power Query is for Data Modeling


Proud to be a Super User!

MCSA: BI Reporting
Anonymous
Not applicable

You could use

 

Table.AddColumn(PriorStepOrTableName, "New Text", each Text.FromBinary(Text.ToBinary([Series_Title])))

 

--Nate

Helpful resources

Announcements
Power BI DataViz World Championships

Power BI Dataviz World Championships

The Power BI Data Visualization World Championships is back! Get ahead of the game and start preparing now!

November Power BI Update Carousel

Power BI Monthly Update - November 2025

Check out the November 2025 Power BI update to learn about new features.

FabCon Atlanta 2026 carousel

FabCon Atlanta 2026

Join us at FabCon Atlanta, March 16-20, for the ultimate Fabric, Power BI, AI and SQL community-led event. Save $200 with code FABCOMM.