Dataflow Gen2 Destination: Merge/Upsert setting

[frithjof_v]

Today, the following data destination options are available in Dataflow Gen2:

• Append
• Overwrite
• Incremental Refresh

We would like an additional option:

• Merge (Upsert) - similar to MERGE in Spark and T-SQL.

This would allow us to:

• Update existing rows based on a join predicate (join key)
• Insert new rows
• Delete rows that no longer exist in the source (optional behavior).