Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Microsoft is giving away 50,000 FREE Microsoft Certification exam vouchers. Get Fabric certified for FREE! Learn more

Reply
ktt777
Helper V
Helper V

Define potential duplications

Hi all,

 

i have a list of entries that was manually entered. There are potential duplications in there.

For example : Star Pte Ltd , Star Pte. Ltd, Stars Pte Ltd

 

Any way to define the list of the potential duplications ?

 

Thanks,

1 ACCEPTED SOLUTION
v-jiewu-msft
Community Support
Community Support

Hi @ktt777 ,

Based on the description, try to create a new column for standardization.

Standard = LOWER(TRIM(SUBSTITUTE([Name], ".", "")))

vjiewumsft_0-1721295369379.png

You can also viewing the following documents to learn more information.

TRIM function (DAX) - DAX | Microsoft Learn

SUBSTITUTE function (DAX) - DAX | Microsoft Learn

 

Best Regards,

Wisdom Wu

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

View solution in original post

3 REPLIES 3
v-jiewu-msft
Community Support
Community Support

Hi @ktt777 ,

Based on the description, try to create a new column for standardization.

Standard = LOWER(TRIM(SUBSTITUTE([Name], ".", "")))

vjiewumsft_0-1721295369379.png

You can also viewing the following documents to learn more information.

TRIM function (DAX) - DAX | Microsoft Learn

SUBSTITUTE function (DAX) - DAX | Microsoft Learn

 

Best Regards,

Wisdom Wu

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

ktt777
Helper V
Helper V

Thank you. Fuzzy matching usually needs 2 columns to match. What if i only have the original data with name variation without the standard data to compare

 

rajendraongole1
Super User
Super User

Hi @ktt777 -in power query editor you can check the fuzzy matching technique. This approach helps to find similarities between strings that are not exact matches but likely refer to the same entity.

In your case, where variations in company names might exist due to abbreviations, punctuation, or slight differences. 

 

Hope it helps

 

Did I answer your question? Mark my post as a solution! This will help others on the forum!
Appreciate your Kudos!!





Did I answer your question? Mark my post as a solution!

Proud to be a Super User!





Helpful resources

Announcements
PBIApril_Carousel

Power BI Monthly Update - April 2025

Check out the April 2025 Power BI update to learn about new features.

Notebook Gallery Carousel1

NEW! Community Notebooks Gallery

Explore and share Fabric Notebooks to boost Power BI insights in the new community notebooks gallery.

April2025 Carousel

Fabric Community Update - April 2025

Find out what's new and trending in the Fabric community.

Top Solution Authors