Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Calling all Data Engineers! Fabric Data Engineer (Exam DP-700) live sessions are back! Starting October 16th. Sign up.

Reply
jtbint
New Member

Incremental Refresh for Dataflows

Hi all,

I have searched some specific questions I have on this topic, but can't seem to find any existing answers. Hoping someone can enlighten me.

 

We are using Dataflows to pull from SAP HANA, but the source table does not have a datetime column (only date). From what I have seen from searching online, incremental refresh on datasets allow you to use functions to convert the date column to datetime, and so this is a non-issue. But that does not seem to be the case with dataflows in the service (at least according to the microsoft documentation). Will I be able to use incremental refresh in the service if the source table has a date column rather than a datetime column? I have attempted to get around this by converting the column to datetime within the query itself, but refresh was extremely slow, even slower than refreshing the entire table. I should also mention that currently the query uses Date.AddMonths to filter out any rows that are older than 1 year. Wasn't sure if I needed to get rid of that filter in order for incremental refresh to work correctly.

 

Any insight would be greatly appreciated, this forum has been very helpful.

 

1 REPLY 1
Greg_Deckler
Community Champion
Community Champion

@jtbint What about using a surrogate integer key like yyyymmdd?



Follow on LinkedIn
@ me in replies or I'll lose your thread!!!
Instead of a Kudo, please vote for this idea
Become an expert!: Enterprise DNA
External Tools: MSHGQM
YouTube Channel!: Microsoft Hates Greg
Latest book!:
DAX For Humans

DAX is easy, CALCULATE makes DAX hard...

Helpful resources

Announcements
FabCon Global Hackathon Carousel

FabCon Global Hackathon

Join the Fabric FabCon Global Hackathon—running virtually through Nov 3. Open to all skill levels. $10,000 in prizes!

October Power BI Update Carousel

Power BI Monthly Update - October 2025

Check out the October 2025 Power BI update to learn about new features.

FabCon Atlanta 2026 carousel

FabCon Atlanta 2026

Join us at FabCon Atlanta, March 16-20, for the ultimate Fabric, Power BI, AI and SQL community-led event. Save $200 with code FABCOMM.

Top Solution Authors