Forum Discussion
Incremental Refresh deleted all history data
Hello
We have an incremental refresh setup to keep data for 5 years and refresh the last month,
the first week in October, after the refresh, all the historical data for two years are removed.
Is this a know issue?
We can reload, which will take a long time and we do not know what caused it and if it will happen again
Hi landrade ,
According to the documentation, incremental refresh will delete the historical partition, When a historical partition is no longer in the historical period defined by the policy, it is removed from the dataset entirely. This is known as a rolling window pattern.
Incremental refresh for datasets and real-time data in Power BI - Power BI | Microsoft Learn
If you feel that the processing of historical partitions by Power BI incremental refresh does not meet expectations, you can connect to this dataset through external tools (such as ssms, tabular editor) to check the configuration of historical partitions.
Dataset connectivity and management with the XMLA endpoint in Power BI - Power BI | Microsoft Learn
Best Regards,
Liu Yang
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
2 Replies
Never had that issue before. But have you checked the partitions in SSMS?
Hi landrade ,
According to the documentation, incremental refresh will delete the historical partition, When a historical partition is no longer in the historical period defined by the policy, it is removed from the dataset entirely. This is known as a rolling window pattern.
Incremental refresh for datasets and real-time data in Power BI - Power BI | Microsoft Learn
If you feel that the processing of historical partitions by Power BI incremental refresh does not meet expectations, you can connect to this dataset through external tools (such as ssms, tabular editor) to check the configuration of historical partitions.
Dataset connectivity and management with the XMLA endpoint in Power BI - Power BI | Microsoft Learn
Best Regards,
Liu Yang
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
