Hi @Analitika ,
If you have tried using the "Remove Duplicates" function in Power Query but are still encountering duplicate values in your table, there are a few additional steps you can take to resolve the issue:
Check Column Data Types: Ensure that the columns you are using to identify duplicates have the correct data types. Sometimes, differences in data types can cause seemingly identical values to be treated as distinct.
Trim and Clean Data: If your data contains leading or trailing spaces or other non-printable characters, it can cause duplicates to appear. Use the "Trim" and "Clean" functions in Power Query to remove any unwanted characters and ensure consistency.
Case Sensitivity: By default, the "Remove Duplicates" function in Power Query is case-sensitive. So, if your values differ only in case (e.g., "John" and "john"), they will be considered as duplicates. You can change the case sensitivity behavior by modifying the comparison options in the "Remove Duplicates" step.
Sort Data: Try sorting your data before applying the "Remove Duplicates" function. Sorting the data can help identify patterns and discrepancies that may not be immediately apparent.
Use Custom Logic: If the built-in "Remove Duplicates" function is not resolving the issue, you can create a custom logic to identify and remove duplicates. For example, you can use the "Group By" function in Power Query to group the data by the columns you want to deduplicate, and then select the first record from each group.
Best Regards,
Ajith Prasath
If this post helps, then please consider Accept it as the solution and give kudos to help the other members find it more quickly.
