Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
5 years ago
Solved

Remove Duplicates - Challenge!

Hello All,

 

Having difficulties with a table. I need to reduce its size to increase performance by selectively removing duplicates. Ideally I would like to do this via PowerQuery. If I must a calculated table would work. Here is a sample of the data. What I am hoping to do is to remove each duplicate in the "Cost" column for each consecutive date for each item. In the table below I indicate the entries that should be removed. The table is currently 350,000 rows and I think it can be reduced to under 100,000. It feeds a complicated dax query that takes a long time to run against such a large table. Please advise.

 

Data:   Result:  
       
Item No.DateCost Item No.DateCost
111111/1/202010 111111/1/202010
111112/1/202010 111113/1/202011
111113/1/202011 111117/1/202012
111114/1/202011 111119/1/202013
111115/1/202011 222221/1/20209
111116/1/202011 222222/1/20208
111117/1/202012 222224/1/202010
111118/1/202012 222229/1/202012
111119/1/202013    
222221/1/20209    
222222/1/20208    
222223/1/20208    
222224/1/202010    
222225/1/202010    
222226/1/202010    
222227/1/202010    
222228/1/202010    
222229/1/202012