Forum Discussion
Rolling Data Capture
Super User
If you place all the data reports (source files) in a folder, you can use the Folder connector. Power Query will automatically append all the data reports in a single table. Remove the column Source.Name and then Remove Duplicates. New data reports will automatically be included when you refresh the Power BI report.
DataInsights Thank you for your response, but all of my data reports are in a single folder. I save them there using PowerAutomate. This leads to a problem though because I end up with duplicates for days that are included in more than one report. I tried removing duplicates, but it removes all instances of the duplicated data, so I end up only showing unique values, which is only the new entries on the previous day's report.... unless there is a trick to remove duplicates I am not aware of.
Below is a snippet where I show one example of duplicated data.
This example I highlighted with the green marks is the same entry that shows up on the three reports. If I were to continue the examples for Jan 26 and Jan 27, you would see that the data entries for the highlighted value would drop off of the daily report on Jan 27, and because it is after the "Base Data", I would lose all visibility to these sales.
What I am looking for is a way to automatically add the highlighted data to the "Base Data" report I created manually that includes all data up to, and including, Jan 21.
Cheers!