Forum Discussion
Solved
Incremental refresh og selected refresh using data pipeline
Hi, Wondering if anyone has done this successfully? I'm using the copy activity to get data from my on-prem sql server. I would like to not overwrite my entire table on each refresh. I eac...
I think you will need to use Notebook to upsert into Lakehouse.
There is an example of upsert here:
https://microsoftlearning.github.io/mslearn-fabric/Instructions/Labs/03b-medallion-lakehouse.html
There is an overview of some functions here:
Please vote for this idea:
Support UPSERTs and DELETEs when copying data into Lakehouse Tables from Pipeline copy activity, as opposed to Appending new rows
https://ideas.fabric.microsoft.com/ideas/idea/?ideaid=87f3d168-6022-ee11-a81c-6045bdc01ce4
On the Ideas site, it says this is under planning, but it has been under planning for a year already. Your vote can highlight the urgency for getting this much-needed feature.