Skip to main content
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Get Fabric Certified for FREE during Fabric Data Days. Don't miss your chance! Request now

Reply
DarinSpence
Helper II
Helper II

Data Flow Gen2 Incremental Refresh

‎08-12-2023 06:06 PM

I have some dimension tables with a Time Updated column in Snowflake.  I'd prefer to SELECT from Snowflake only the rows with a Time Updated since the last refresh; and UPDATE the table in the Lakehouse.

 

Is there a method with Data Flow Gen2 to do something like Data Flow Gen1's incremental refresh?

Labels:
Message 1 of 3
431 Views
0
2 REPLIES 2
aj1973
Community Champion
Community Champion

‎08-12-2023 06:32 PM

Hi @DarinSpence 

In Power Query select the Date column and filtered to the last date.

Regards
Amine Jerbi

If I answered your question, please mark this thread as accepted
and you can follow me on
My Website, LinkedIn and Facebook

Message 2 of 3
418 Views
0
DarinSpence
Helper II
Helper II
In response to aj1973

‎08-12-2023 06:35 PM

When I tried that with Data Flow Gen2 Append, I got new; duplicate rows 😕

Message 3 of 3
407 Views
0

Helpful resources

Announcements
November Power BI Update Carousel

Power BI Monthly Update - November 2025

Check out the November 2025 Power BI update to learn about new features.

Fabric Data Days Carousel

Fabric Data Days

Advance your Data & AI career with 50 days of live learning, contests, hands-on challenges, study groups & certifications and more!

FabCon Atlanta 2026 carousel

FabCon Atlanta 2026

Join us at FabCon Atlanta, March 16-20, for the ultimate Fabric, Power BI, AI and SQL community-led event. Save $200 with code FABCOMM.

View All
Top Solution Authors
View All