Skip to main content
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

We've captured the moments from FabCon & SQLCon that everyone is talking about, and we are bringing them to the community, live and on-demand. Starts on April 14th. Register now

Reply
DarinSpence
Helper II
Helper II

Data Flow Gen2 Incremental Refresh

‎08-12-2023 06:06 PM

I have some dimension tables with a Time Updated column in Snowflake.  I'd prefer to SELECT from Snowflake only the rows with a Time Updated since the last refresh; and UPDATE the table in the Lakehouse.

 

Is there a method with Data Flow Gen2 to do something like Data Flow Gen1's incremental refresh?

Labels:
Message 1 of 3
512 Views
0
2 REPLIES 2
aj1973
Community Champion
Community Champion

‎08-12-2023 06:32 PM

Hi @DarinSpence 

In Power Query select the Date column and filtered to the last date.

Regards
Amine Jerbi

If I answered your question, please mark this thread as accepted
and you can follow me on
My Website, LinkedIn and Facebook

Message 2 of 3
499 Views
0
DarinSpence
Helper II
Helper II
In response to aj1973

‎08-12-2023 06:35 PM

When I tried that with Data Flow Gen2 Append, I got new; duplicate rows 😕

Message 3 of 3
488 Views
0

Helpful resources

Announcements
New to Fabric survey Carousel

New to Fabric Survey

If you have recently started exploring Fabric, we'd love to hear how it's going. Your feedback can help with product improvements.

Power BI DataViz World Championships carousel

Power BI DataViz World Championships - June 2026

A new Power BI DataViz World Championship is coming this June! Don't miss out on submitting your entry.

Join our Fabric User Panel

Join our Fabric User Panel

Share feedback directly with Fabric product managers, participate in targeted research studies and influence the Fabric roadmap.

March Power BI Update Carousel

Power BI Community Update - March 2026

Check out the March 2026 Power BI update to learn about new features.

View All