frithjof_v's avatar
frithjof_v
Icon for Community Champion rankCommunity Champion
6 months ago
Status:
Needs Votes

Dataflow Gen2 Destination: Merge/Upsert setting

Today, the following data destination options are available in Dataflow Gen2:

  • Append
  • Overwrite
  • Incremental Refresh

We would like an additional option:

  • Merge (Upsert) - similar to MERGE in Spark and T-SQL.

This would allow us to:

  • Update existing rows based on a join predicate (join key)
  • Insert new rows
  • Delete rows that no longer exist in the source (optional behavior).

1 Comment

Recent ideas