Forum Discussion
Solved
Incremental refresh og selected refresh using data pipeline
Hi, Wondering if anyone has done this successfully? I'm using the copy activity to get data from my on-prem sql server. I would like to not overwrite my entire table on each refresh. I eac...
I think you will need to use Notebook to upsert into Lakehouse.
There is an example of upsert here:
https://microsoftlearning.github.io/mslearn-fabric/Instructions/Labs/03b-medallion-lakehouse.html
There is an overview of some functions here:
There is not currently a way to do this with only the Copy Data activity.
If you want to use auxiliary/raw/landing tables, you cannot update a Lakehouse table with the SQL Endpoint. You can with a Notebook.
If you want to write with SQL, you can use auxiliary/raw/landing tables in a Warehouse and make a shortcut inside the Lakehouse pointing to the Warehouse table.