Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Don't miss out! 2025 Microsoft Fabric Community Conference, March 31 - April 2, Las Vegas, Nevada. Use code MSCUST for a $150 discount. Prices go up February 11th. Register now.

Reply
KNO
Helper I
Helper I

Delta Lake and incremental refresh - how?

HI

I have a Delta Lake dataset called 'hourdata'. It contains 150 million rows and consumes alot of memory. I have tried to do incremental refresh configuration in Power BI Desktop top with no success. Delta Lake does not seem be support Query Folding. So I have only one partions  at the moment. 

Udklip.PNG

My question is as follow

  • How can I break down the dataset in smaller partition, without changing data source. 

 

Thanks 

 

1 REPLY 1
lbendlin
Super User
Super User

"Delta Lake does not seem to support Query Folding. So I have only one partition at the moment. "

 

These things are not related.  You don't need Query Folding for incremental refresh (although it would help).  What you do need is a step in your Power Query that includes a RangeStart and RangeEnd filter.  Do you have that?

Helpful resources

Announcements
Las Vegas 2025

Join us at the Microsoft Fabric Community Conference

March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount!

Jan25PBI_Carousel

Power BI Monthly Update - January 2025

Check out the January 2025 Power BI update to learn about new features in Reporting, Modeling, and Data Connectivity.

Jan NL Carousel

Fabric Community Update - January 2025

Find out what's new and trending in the Fabric community.