Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Be one of the first to start using Fabric Databases. View on-demand sessions with database experts and the Microsoft product team to learn just how easy it is to get started. Watch now

Reply
KNO
Helper I
Helper I

Delta Lake and incremental refresh - how?

HI

I have a Delta Lake dataset called 'hourdata'. It contains 150 million rows and consumes alot of memory. I have tried to do incremental refresh configuration in Power BI Desktop top with no success. Delta Lake does not seem be support Query Folding. So I have only one partions  at the moment. 

Udklip.PNG

My question is as follow

  • How can I break down the dataset in smaller partition, without changing data source. 

 

Thanks 

 

1 REPLY 1
lbendlin
Super User
Super User

"Delta Lake does not seem to support Query Folding. So I have only one partition at the moment. "

 

These things are not related.  You don't need Query Folding for incremental refresh (although it would help).  What you do need is a step in your Power Query that includes a RangeStart and RangeEnd filter.  Do you have that?

Helpful resources

Announcements
Las Vegas 2025

Join us at the Microsoft Fabric Community Conference

March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount!

Dec Fabric Community Survey

We want your feedback!

Your insights matter. That’s why we created a quick survey to learn about your experience finding answers to technical questions.

ArunFabCon

Microsoft Fabric Community Conference 2025

Arun Ulag shares exciting details about the Microsoft Fabric Conference 2025, which will be held in Las Vegas, NV.

December 2024

A Year in Review - December 2024

Find out what content was popular in the Fabric community during 2024.