Forum Discussion

RMW13's avatar
RMW13
Regular Visitor
3 years ago

Rolling Data Capture

Hello Everyone,   I get daily reports with what I consider to be "rolling data".  I've created an example below to show how the data reports are received.  The daily data report is sent out overnig...
Need Help
RMW13's avatar
RMW13
Regular Visitor
3 years ago

I keep all reports in the same folder.

 

Regarding the suggestion to remove duplicates... I've tried this, but when I do it, it removes all instances of the duplicate, so I'm left with only the new entries.  Is there a way the duplicated instances only?  I know in Excel when you remove duplicates, it leaves you with the original instance, but I can't seem to get that to work in PBI/PQ.

DataInsights's avatar
DataInsights
Super User
3 years ago

RMW13,

 

What columns are in the table when you apply the Remove Duplicates step? If there is a column like "Source.Name" that is creating uniqueness, then that column needs to be removed. Or, you can use the second argument of Table.Distinct to specify the columns to test for uniqueness. Can you provide before and after screenshots of your Power Query table (before and after you remove duplicates), as well as the M code?