Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Find everything you need to get certified on Fabric—skills challenges, live sessions, exam prep, role guidance, and more. Get started

Reply
landrade
New Member

Incremental Refresh deleted all history data

Hello

 

We have an incremental refresh setup to keep data for 5 years and refresh the last month,

the first week in October, after the refresh, all the historical data for two years are removed.

 

Is this a know issue?

We can reload, which will take a long time and we do not know what caused it and if it will happen again

1 ACCEPTED SOLUTION
v-yangliu-msft
Community Support
Community Support

Hi  @landrade ,

According to the documentation, incremental refresh will delete the historical partition, When a historical partition is no longer in the historical period defined by the policy, it is removed from the dataset entirely. This is known as a rolling window pattern.

vyangliumsft_0-1667348289271.png

Incremental refresh for datasets and real-time data in Power BI - Power BI | Microsoft Learn

If you feel that the processing of historical partitions by Power BI incremental refresh does not meet expectations, you can connect to this dataset through external tools (such as ssms, tabular editor) to check the configuration of historical partitions.

Dataset connectivity and management with the XMLA endpoint in Power BI - Power BI | Microsoft Learn

Advanced incremental refresh and real-time data with the XMLA endpoint in Power BI - Power BI | Micr...

 

Best Regards,

Liu Yang

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

View solution in original post

2 REPLIES 2
v-yangliu-msft
Community Support
Community Support

Hi  @landrade ,

According to the documentation, incremental refresh will delete the historical partition, When a historical partition is no longer in the historical period defined by the policy, it is removed from the dataset entirely. This is known as a rolling window pattern.

vyangliumsft_0-1667348289271.png

Incremental refresh for datasets and real-time data in Power BI - Power BI | Microsoft Learn

If you feel that the processing of historical partitions by Power BI incremental refresh does not meet expectations, you can connect to this dataset through external tools (such as ssms, tabular editor) to check the configuration of historical partitions.

Dataset connectivity and management with the XMLA endpoint in Power BI - Power BI | Microsoft Learn

Advanced incremental refresh and real-time data with the XMLA endpoint in Power BI - Power BI | Micr...

 

Best Regards,

Liu Yang

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Tutu_in_YYC
Resident Rockstar
Resident Rockstar

Never had that issue before. But have you checked the partitions in SSMS?


Helpful resources

Announcements
Europe Fabric Conference

Europe’s largest Microsoft Fabric Community Conference

Join the community in Stockholm for expert Microsoft Fabric learning including a very exciting keynote from Arun Ulag, Corporate Vice President, Azure Data.

Power BI Carousel June 2024

Power BI Monthly Update - June 2024

Check out the June 2024 Power BI update to learn about new features.

RTI Forums Carousel3

New forum boards available in Real-Time Intelligence.

Ask questions in Eventhouse and KQL, Eventstream, and Reflex.

Top Solution Authors