Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Did you hear? There's a new SQL AI Developer certification (DP-800). Start preparing now and be one of the first to get certified. Register now

Reply
Anonymous
Not applicable

Remove duplicates in values (string)

Hello, 

 

I have in a column, values including some duplicates :

 

Ex :

Input :

IDValue
ID1A-B-A-C-A
ID2A-B
ID3A-C-C

 

Expected Output :

 

ID

Value
ID1A-B-C
ID2A-B
ID3A-C

 

Thanks in advance for your help

1 ACCEPTED SOLUTION
Anonymous
Not applicable

Hi @Anonymous ,

Please refer to my pbix file to see if it helps you.

Create a custom column in Power Query.

=Text.Combine (
                List.Distinct(
                          List.Transform (Text.Split([Value],"-"),each Text.Trim(_))
                                  )
                     ,"- ")

vpollymsft_0-1655779988858.png

vpollymsft_1-1655780004617.png

 

Best Regards

Community Support Team _ Polly

 

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

View solution in original post

2 REPLIES 2
Anonymous
Not applicable

Hi @Anonymous ,

Please refer to my pbix file to see if it helps you.

Create a custom column in Power Query.

=Text.Combine (
                List.Distinct(
                          List.Transform (Text.Split([Value],"-"),each Text.Trim(_))
                                  )
                     ,"- ")

vpollymsft_0-1655779988858.png

vpollymsft_1-1655780004617.png

 

Best Regards

Community Support Team _ Polly

 

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Greg_Deckler
Community Champion
Community Champion

@Anonymous Use Text to Table, replace - with | see the first comment below this entry:

Text to Table - Microsoft Power BI Community

Then you can use DISTINCT and CONCATENATEX to recombine with your dashes. 



Follow on LinkedIn
@ me in replies or I'll lose your thread!!!
Instead of a Kudo, please vote for this idea
Become an expert!: Enterprise DNA
External Tools: MSHGQM
YouTube Channel!: Microsoft Hates Greg
Latest book!:
DAX For Humans

DAX is easy, CALCULATE makes DAX hard...

Helpful resources

Announcements
April Power BI Update Carousel

Power BI Monthly Update - April 2026

Check out the April 2026 Power BI update to learn about new features.

Fabric SQL PBI Data Days

Data Days 2026 coming soon!

Sign up to receive a private message when registration opens and key events begin.

New to Fabric survey Carousel

New to Fabric Survey

If you have recently started exploring Fabric, we'd love to hear how it's going. Your feedback can help with product improvements.

Power BI DataViz World Championships carousel

Power BI DataViz World Championships - June 2026

A new Power BI DataViz World Championship is coming this June! Don't miss out on submitting your entry.