Forum Discussion
Remove Duplicates - Challenge!
Hello All,
Having difficulties with a table. I need to reduce its size to increase performance by selectively removing duplicates. Ideally I would like to do this via PowerQuery. If I must a calculated table would work. Here is a sample of the data. What I am hoping to do is to remove each duplicate in the "Cost" column for each consecutive date for each item. In the table below I indicate the entries that should be removed. The table is currently 350,000 rows and I think it can be reduced to under 100,000. It feeds a complicated dax query that takes a long time to run against such a large table. Please advise.
| Data: | Result: | |||||
| Item No. | Date | Cost | Item No. | Date | Cost | |
| 11111 | 1/1/2020 | 10 | 11111 | 1/1/2020 | 10 | |
| 11111 | 3/1/2020 | 11 | ||||
| 11111 | 3/1/2020 | 11 | 11111 | 7/1/2020 | 12 | |
| 11111 | 9/1/2020 | 13 | ||||
| 22222 | 1/1/2020 | 9 | ||||
| 22222 | 2/1/2020 | 8 | ||||
| 11111 | 7/1/2020 | 12 | 22222 | 4/1/2020 | 10 | |
| 22222 | 9/1/2020 | 12 | ||||
| 11111 | 9/1/2020 | 13 | ||||
| 22222 | 1/1/2020 | 9 | ||||
| 22222 | 2/1/2020 | 8 | ||||
| 22222 | 4/1/2020 | 10 | ||||
| 22222 | 9/1/2020 | 12 |
- Anonymous5 years ago
Looks like I found the solution in this tutorial:
Cheers.
2 Replies
- AnonymousNot applicable
Looks like I found the solution in this tutorial:
Cheers.
- v-easonf-msftCommunity Support
Hi, Anonymous
It's pleasant that your problem has been solved.
Thanks for your sharing.
Best Regards,
Community Support Team _ Eason