Check your eligibility for this 50% exam voucher offer and join us for free live learning sessions to get prepared for Exam DP-700.
Get StartedJoin us at the 2025 Microsoft Fabric Community Conference. March 31 - April 2, Las Vegas, Nevada. Use code FABINSIDER for $400 discount. Register now
Hi
I don't see an option to upsert (insert new rows and update existing rows based on PK) in copy activity or in data flow gen2. Is there an alternative how I can acheive this? I am using Azure SQL Warehouse in Fabric as target.
Regards
Subbu
Solved! Go to Solution.
Hi Thanks for the response.
I used a work around, I load the data to a stage table and then created a procedure to left join the stage table & actual table to compare & insert missing records and update the existing records with 2 seperate SQL statements (first for update and then for insert).
Hi Thanks for the response.
I used a work around, I load the data to a stage table and then created a procedure to left join the stage table & actual table to compare & insert missing records and update the existing records with 2 seperate SQL statements (first for update and then for insert).
Can you tell me if your problem is solved? If yes, please accept it as solution.
Regards,
Nono Chen
Thanks for your quick response. I am looking for upsert option in data pipelines or data flow gen2. I understand MERGE command is not available in Azure SQL Warehouse as of now. But in one of the thread in the link https://community.fabric.microsoft.com/t5/Data-Pipelines/Fabric-Data-Factory-Pipeline-Incremental-lo... I understand this is now enabled in a private view This is the part of the comment I read. Hence wanted to check if there is a way to get the upsert (Its in private preview, please ping me with your workspace id, and we can enable it for you along with instructions.)
Based on my knowlegde, Upsert/Merge is not yet directly supported for fabric warehouse.
So you would have to copy the data into a staging table and then leverage the below logic to upsert into destination table
March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount!
Check out the February 2025 Fabric update to learn about new features.
User | Count |
---|---|
6 | |
4 | |
2 | |
1 | |
1 |
User | Count |
---|---|
13 | |
10 | |
5 | |
5 | |
4 |