Forum Discussion
Remove Duplicate Datasets
- 9 years ago
Please check below,
The two way to remove duplicates would be:
1. There is a "remove duplicates" operation in the user interface of the "Edit Queries" Section (this is Power Query). Under the Transform tab, there is a "Remove Rows" icon with a small downward triangle next to it. Click that triangle to bring up a list. On that list is an option to remove duplicates. Also, you can Right Click on a column header and that displays a list that also gives you the option to remove duplicates.
2. Depending on the shape of your data, duplicates may not be a bad thing. For example, if your "ID" column is, say, an employee ID and your table is showing transactions in a day, the employee ID could be duplicated intentionally if your database is set up for creating a new record for each transaction. Anyway, the point is that you only want to use Option 1 if the duplicate entries are truly duplicates, meaning they provide no extra information. If, on the other hand, the entries are not "true duplicates" then you will want to use the "Group By" functionality. If you have any Microsoft Access (or SQL) experience, this is basically created an aggregate, or totals, query. So this will allow you to group all the duplicate instances of the ID column yet still retain the important details in aggregate. This would mean you would essentially sum up all the cash amount columns for each ID and create 1 row for each ID.
I hope that makes sense. Good luck.