Remove Duplicates - Challenge!

[Anonymous]

Hello All,

Having difficulties with a table. I need to reduce its size to increase performance by selectively removing duplicates. Ideally I would like to do this via PowerQuery. If I must a calculated table would work. Here is a sample of the data. What I am hoping to do is to remove each duplicate in the "Cost" column for each consecutive date for each item. In the table below I indicate the entries that should be removed. The table is currently 350,000 rows and I think it can be reduced to under 100,000. It feeds a complicated dax query that takes a long time to run against such a large table. Please advise.

Data:				Result:
Item No.	Date	Cost		Item No.	Date	Cost
11111	1/1/2020	10		11111	1/1/2020	10
11111	2/1/2020	10		11111	3/1/2020	11
11111	3/1/2020	11		11111	7/1/2020	12
11111	4/1/2020	11		11111	9/1/2020	13
11111	5/1/2020	11		22222	1/1/2020	9
11111	6/1/2020	11		22222	2/1/2020	8
11111	7/1/2020	12		22222	4/1/2020	10
11111	8/1/2020	12		22222	9/1/2020	12
11111	9/1/2020	13
22222	1/1/2020	9
22222	2/1/2020	8
22222	3/1/2020	8
22222	4/1/2020	10
22222	5/1/2020	10
22222	6/1/2020	10
22222	7/1/2020	10
22222	8/1/2020	10
22222	9/1/2020	12

[v-easonf-msft]

Hi， @Anonymous 

It's pleasant that your problem has been solved.

Thanks for your sharing.

Best Regards,
Community Support Team _ Eason

[Anonymous · Accepted solution]

Looks like I found the solution in this tutorial:

https://exceltown.com/en/tutorials/power-bi/powerbi-com-and-power-bi-desktop/power-bi-data-sources/p...

Cheers.