Forum Discussion
Issue with Upsert Table Action in Metadata-Driven Pipeline to Lakehouse Table
- 1 year ago
Hi parasol54
Warehouse tables in Fabric Data Warehouse = Lakehouse Tables.
That means Whatever you are doing in Lakehouse ( such as creating Delta table) is also applies to Data Warehouse Tables. ( Unified Data )
Lakehouse Delta Tables
Data Warehouse Tables
No limitation applies. Whether you create a Lakehouse or Warehouse Tables. I would highly recommend you to use Notebooks and Delta Tables. That way you would understand Data Lake and how it migrated to Delta Lake.
- 1 year ago
Hi parasol54 ,
Thanks for reaching out to the Microsoft fabric community forum.
lbendlin ,
Thanks for your prompt response
Since the Copy Activity in Microsoft Fabric doesn’t currently support the 'Upsert' action for Lakehouse Delta tables, a practical workaround is to load your data into a staging table using 'Overwrite' mode, then use a notebook (SQL or Python) to perform a merge operation into your destination table based on defined key columns this approach simulates upsert behavior by updating matching records and inserting new ones, and it integrates well into a metadata-driven pipeline if you extend your control table to include merge rules.
Lakehouse and Delta Tables - Microsoft Fabric | Microsoft Learn
Options to get data into the Lakehouse - Microsoft Fabric | Microsoft Learn
Best Regards,
Lakshmi Narayana
Hi parasol54 ,
Thanks for reaching out to the Microsoft fabric community forum.
lbendlin ,
Thanks for your prompt response
Since the Copy Activity in Microsoft Fabric doesn’t currently support the 'Upsert' action for Lakehouse Delta tables, a practical workaround is to load your data into a staging table using 'Overwrite' mode, then use a notebook (SQL or Python) to perform a merge operation into your destination table based on defined key columns this approach simulates upsert behavior by updating matching records and inserting new ones, and it integrates well into a metadata-driven pipeline if you extend your control table to include merge rules.
Lakehouse and Delta Tables - Microsoft Fabric | Microsoft Learn
Options to get data into the Lakehouse - Microsoft Fabric | Microsoft Learn
Best Regards,
Lakshmi Narayana
- v-lgarikapat1 year ago
Community Support
Hi parasol54 ,
I wanted to follow up and confirm whether you’ve had a chance to review the information we shared. If you have any questions or need further clarification, please don’t hesitate to reach out.
If you're still encountering any challenges, feel free to let us know we’d be glad to assist you further.
Looking forward to your response.
Best regards,
Lakshmi Narayana- v-lgarikapat1 year ago
Community Support
Hi parasol54 ,
If your issue has been resolved, please consider marking the most helpful reply as the accepted solution. This helps other community members who may encounter the same issue to find answers more efficiently.
If you're still facing challenges, feel free to let us know we’ll be glad to assist you further.
Looking forward to your response.
Best regards,
LakshmiNarayana.- v-lgarikapat1 year ago
Community Support
Hi parasol54 ,
As we haven't received a response from you, we will proceed to close this thread. If you're still experiencing the issue, please feel free to create a new thread we’ll be happy to assist you further.
Thank you for your patience and continued support.
If our response was helpful, we kindly ask you to mark it as Accepted as Solution. This helps other community members find answers more efficiently.
Best Regards,Lakshmi Narayana