Forum Discussion
Update FACT based only weekly exports
Hi
I have a dataset which includeds 3 data sources (excel files), all of which are exported on a weekly basis i.e. an excel file for Dec week 1, Dec week 2 etc.
What is the best way to structure queries, so that I can update the fact to include the new data alongside the original.
Thanks
Mark
3 Replies
- greggybResident Rockstar
Power BI Desktop does not support incremental data load, so you will always process the entire dataset.
You can connect to a folder with multiple files of the same format, and Power Query will automatically append the data from each file in the folder. This depends on the files having the same structure. The link is for Excel, but Power BI Power Query has identical functionality.
- Greg_DecklerCommunity Champion
greggyb - Great minds think alike! :)
- Greg_DecklerCommunity Champion
A little sparse on details here, but you might look at using "Folder" as your data source. The idea behind Folder is that you have a bunch of files all with the same format and it will automatically process all of the files in the folder you specify and essentially create a big Append query so that they all end up in the same table together. You could have 3 of these Folder queries, one for each data source and as you drop new files in, they would be added to the data set.