Forum Discussion
Data Flow Gen2 Incremental Refresh
I have some dimension tables with a Time Updated column in Snowflake. I'd prefer to SELECT from Snowflake only the rows with a Time Updated since the last refresh; and UPDATE the table in the Lakehouse.
Is there a method with Data Flow Gen2 to do something like Data Flow Gen1's incremental refresh?
2 Replies
Hi DarinSpence
In Power Query select the Date column and filtered to the last date.
When I tried that with Data Flow Gen2 Append, I got new; duplicate rows 😕
