Appending History Table with data from another table imported from the web

[Pandadev]

I am trying to find a solution where i can update a historic table with daily imports I am importing into a table called imports.

So I have a history table and Imports Table.

The imports are run daily but as it is from a web source it contains all the data for the current month only. So when I do a daily refresh , the imports table will show all the current rows of data for the current month.

I need to be able to import those to the history table and remove any duplicates.

This is because when the month changes , the previous months data will not be showing in the imports table anymore. so I have to have a way to transfer the data each time to the history ftable then remove dupes in the history table.

Is this possible in PowerBI please

[v-xicai · Accepted solution]

Hi @Pandadev ,

You may set Incremental refresh for your Web data source.  The  Incremental refresh can significantly reduce data refresh duration, especially for large model tables, and only data that has changed needs to be refreshed . See more: Incremental refresh in Power BI Premium

Best Regards,

Amy 

Community Support Team _ Amy

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[amitchandak]

@Pandadev , refer if this can help

https://www.thebiccountant.com/2017/01/11/incremental-load-in-powerbi-using-dax-union/