Forum Discussion

markhos's avatar
markhos
New Member
10 years ago

Update FACT based only weekly exports

Hi

 

I have a dataset which includeds 3 data sources (excel files), all of which are exported on a weekly basis i.e. an excel file for Dec week 1, Dec week 2 etc.

 

What is the best way to structure queries, so that I can update the fact to include the new data alongside the original.


Thanks

 

Mark

3 Replies

  • greggyb's avatar
    greggyb
    Resident Rockstar

    Power BI Desktop does not support incremental data load, so you will always process the entire dataset.

     

    You can connect to a folder with multiple files of the same format, and Power Query will automatically append the data from each file in the folder. This depends on the files having the same structure. The link is for Excel, but Power BI Power Query has identical functionality.

  • Greg_Deckler's avatar
    Greg_Deckler
    Community Champion

    A little sparse on details here, but you might look at using "Folder" as your data source. The idea behind Folder is that you have a bunch of files all with the same format and it will automatically process all of the files in the folder you specify and essentially create a big Append query so that they all end up in the same table together. You could have 3 of these Folder queries, one for each data source and as you drop new files in, they would be added to the data set.