Forum Discussion
Incremental Refresh & Historical Data
I seem to be misunderstanding something about incremental refresh, but I couldn't figure out what.
I managed to set up the paramenters and filtered the table I want to incrementally refresh, set up the refresh itself with 4 years of historical data and 1 month of refresh, but when I refresh the dataset the table is empty.
If I set the start date sufficiently far back, each refresh once more pulls the whole table again, not just the month to be refreshed.
I was going by this guide: https://www.youtube.com/watch?v=fZVtlckIYvY
Any ideas?
3 Replies
Hi zahlenschubser ,
What's the data source? Which table you configure incremental refresh on? Could you please check and confirm if that table in the underlying data source exist the data which is from 4 years from to "current" data exactly? And you can refer the following official documentations to configure incremental refresh:
Incremental refresh for datasets and real-time data in Power BI - Power BI | Microsoft Learn
Configure incremental refresh and real-time data for Power BI datasets - Power BI | Microsoft Learn
In Archive data starting, specify the historical store period you want to include in the dataset. All rows with dates in this period will be loaded into the dataset in the service, unless other filters apply.
In Incrementally refresh data starting, specify the refresh period. All rows with dates in this period will be refreshed in the dataset each time a manual or scheduled refresh operation is performed by the Power BI service.
Best Regards
The source is a mysql database with several large tables, so I am trying to shorten the loading times as much as possible, and incremental refresh should help a lot here.
The underlying datasource doesn't have entries that old, but I want to eventually keep that much data archived. The source gets cut off 9 months prior to the current data and I cannot change that, so I need to work around it.
I would really appreciate some assistance here =(
