topic Re: Microsoft Fabric - Data Factory - Update/Upsert option not available in Copy Activity for Warehouse in Pipelines

Microsoft Fabric - Data Factory - Update/Upsert option not available in Copy Activity for Warehouse

Anonymous — Fri, 28 Jun 2024 05:45:51 GMT

Hi Team,

I am trying to load data into Fabric - Synapse Data Warehouse. But I surprised there is no option in the Data Pipeline Copy activity either to Update or Upsert which normally available in Azure Data Factory for Azure SQL DBs.

Question is How are we performing the Update or Upsert option in Fabric Synapse Warehouse using Fabric Data Factory.

Azure Data Factory (Sink : Azure SQL)

Microsoft Fabric Data Factory - Data Pipeline (Copy Activity - Sink : Fabric Synapse Data Warehouse)

Regards,

Sathish Kumar Mathivanan

Re: Microsoft Fabric - Data Factory - Update/Upsert option not available in Copy Activity for Warehouse

Anonymous — Fri, 28 Jun 2024 07:26:50 GMT

Please check below thread

Solved: upsert option missing in copy data activity - Microsoft Fabric Community

Re: Microsoft Fabric - Data Factory - Update/Upsert option not available in Copy Activity for Warehouse

Anonymous — Fri, 28 Jun 2024 07:35:57 GMT

Hi Anonymous,

Thanks for the reference link.

As per the microsoft plan, UPSERT will be available Q1 2024 in Dataflow Gen2. But no information on the data pipeline.

Regards,

Sathish Kumar Mathivanan

Re: Microsoft Fabric - Data Factory - Update/Upsert option not available in Copy Activity for Warehouse

jwinchell40 — Fri, 28 Jun 2024 14:44:41 GMT

Anonymous - I agree it would be nice if the upsert options was just baked into the Pipeline as an option. The way that I've implemented this in our environments is just writing the data to a new delta table and passing the name of the new table as a parameter into a Notebook. Then I just run a simple Upsert using the Merge command and it works fine for now.

Happy to share a code snippet we are using if it helps at all.

Re: Microsoft Fabric - Data Factory - Update/Upsert option not available in Copy Activity for Warehouse

mkjit256 — Mon, 10 Mar 2025 12:20:59 GMT

Hello,
Do we have any update about that? Still DataFlow Gen 2 doesn't have the upsert option

Re: Microsoft Fabric - Data Factory - Update/Upsert option not available in Copy Activity for Warehouse

hedeencharles — Mon, 24 Mar 2025 17:17:39 GMT

It would be great to get an update here. The Upsert in Copy Data activity would be fantastic.

Re: Microsoft Fabric - Data Factory - Update/Upsert option not available in Copy Activity for Warehouse

MudassirAli — Thu, 19 Jun 2025 16:17:46 GMT

The option for upsert is finally in Data Pipelin in Fabric. The feature is in Preview at the moment:

https://community.fabric.microsoft.com/t5/Data-Pipeline/Upsert-in-copy-activity/td-p/3369751