Forum Discussion
Append query to dataset and remove outdated data
I want to have a dataset in my Power BI file with 2 years worth of transactional data. This creates over 600M rows.
Instead of refreshing the entire dataset each time I run the report, is there a way to only run the query for missing data (connected to a Teradata DB) and append it to an existing data set with the majority of the data? Then I would like to remove transactional data that has exceeded 2 years.
Refreshing over 600M rows takes a few hours and I'd prefer to find a more efficient way to keep this data current.
4 Replies
Hi Anonymous ,
If you have a Premium license, you can use incremental refresh in the service. Here is the document for your reference.
https://docs.microsoft.com/en-us/power-bi/service-dataflows-incremental-refreshAs for the desktop, I don't think that there is anyway to actually do an incremental load on a Desktop model.
