Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Join the Fabric FabCon Global Hackathon—running virtually through Nov 3. Open to all skill levels. $10,000 in prizes! Register now.

Reply
rohanpawar959
New Member

Power BI Incremental Refresh loading the rows partially in partition after scheduled refresh

I have implemented the incremental refresh for 3 tables in my data model. But one table is loading the data partially instead of loading all the rows. Below are the details:

Source: Databricks

Load Mode: Import

Refresh Frequency: Once every day

 

The data is quite huge (4 Million rows/day) and it's not possible to load 1 year's of data onto a desktop and publish it every day as it was attempting full refresh and it would time out. To tackle this issue we published the data model with limited rows (Using StartRange and StartEnd filter) and then updated the historical partitions through the SSMS XMLA endpoint. 

The below image shows my partitions (Notice the row count for 2023Q10213):
8559cb96-9fd6-4444-a978-ce51f8224981.png

I have scheduled it to refresh once every day. The problem is that when a refresh happens all tables except one get refreshed properly but for one table the rows are loaded partially. When I delete the partition, recreate it, and load it manually then it loads all the rows in the partition. You can see below image, compared to the above image, that rows are now fully loaded after I deleted, recreated, and loaded the partition manually (2023Q10213):

rohanpawar959_0-1676412493117.png

 

Can someone please guide me on how to debug this issue as well as what's the reason behind this behavior? I am attaching my increment policy screenshot below:

rohanpawar959_1-1676412664674.png

 

Thank you!

 

0 REPLIES 0

Helpful resources

Announcements
September Power BI Update Carousel

Power BI Monthly Update - September 2025

Check out the September 2025 Power BI update to learn about new features.

FabCon Atlanta 2026 carousel

FabCon Atlanta 2026

Join us at FabCon Atlanta, March 16-20, for the ultimate Fabric, Power BI, AI and SQL community-led event. Save $200 with code FABCOMM.

Top Solution Authors