Skip to main content
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

July 7 - July 17 | Round 2 of the Power BI Dataviz World Championships. Don't miss your chance! Learn more

Reply
DarinSpence
Helper II
Helper II

Data Flow Gen2 Incremental Refresh

‎08-12-2023 06:06 PM

I have some dimension tables with a Time Updated column in Snowflake.  I'd prefer to SELECT from Snowflake only the rows with a Time Updated since the last refresh; and UPDATE the table in the Lakehouse.

 

Is there a method with Data Flow Gen2 to do something like Data Flow Gen1's incremental refresh?

Labels:
Message 1 of 3
591 Views
0
2 REPLIES 2
aj1973
Community Champion
Community Champion

‎08-12-2023 06:32 PM

Hi @DarinSpence 

In Power Query select the Date column and filtered to the last date.

Regards
Amine Jerbi

If I answered your question, please mark this thread as accepted
and you can follow me on
My Website, LinkedIn and Facebook

Message 2 of 3
578 Views
0
DarinSpence
Helper II
Helper II
In response to aj1973

‎08-12-2023 06:35 PM

When I tried that with Data Flow Gen2 Append, I got new; duplicate rows 😕

Message 3 of 3
567 Views
0

Helpful resources

Announcements
FabCon and SQLCon Barcelona 2026

FabCon & SQLCon – Barcelona 2026

Join us in Barcelona for FabCon and SQLCon, the Fabric, Power BI, SQL, and AI community event. Save €200 with code FABCMTY200.

60 days of Data Days Carousel

Data Days 2026

Join Data Days 2026: 60 days of free live/on-demand sessions, challenges, study groups, and certification opportunities.

Power BI DataViz World Championships carousel

Power BI DataViz World Championships - June 2026

A new Power BI DataViz World Championship is coming this June! Don't miss out on submitting your entry.

View All
Top Kudoed Authors
View All