Removing Duplicates

Hey Anonymous ,

To keep only the English description, you need a slightly different approach. Here are a couple of options I recall:

Option-1: Use a Helper Column with a Formula

1) Add a new column namely may be "Language Check".

2) Use a formula to identify English descriptions. For example:

=IF(ISNUMBER(SEARCH("A-Z",[@MaterialDescription])),"English","Other")

Adjust logic based on your data pattern. If English descriptions contain only Latin letters.

3) Filter the helper column to show only “English” and then remove duplicates based on Material Number.

After that you can easily remove the duplications.

Option-2: Use Power Query

1) Load your data into Power Query.

2) Sort the data so that English descriptions appear first for each Material Number.

3) Use Remove Duplicates in Power Query, keeping the first occurrence (which will be English).

Load the cleaned data back to Excel.

Both approaches are worked fine.

Best Regards,
Nasif Azam

It’s straightforward to remove duplicates in the query editor. Simply select Material Number, right-click, and choose Remove Duplicates—this works if you only need one row per material number. If you require more detail, you’ll need to include all other relevant columns except for Material Description.  The real challenge lies in detecting the language of a free-text field, since neither M nor DAX provides a built-in function for language identification that doesnt use some web service API.