Forum Discussion
Copy Job does an Append for FULL Load, cannot be changed
Hi ToddChitt,
I think when you first create the copy job you need to click on the advanced settings and change it from append to overwrite. As far as I know there's no way to change this after the copy job has been created.
I've always used a script task in a pipeline to truncate the table first, then run the copy job. I've found that to be more reliable.
Hi ToddChitt,
I think when you first create the copy job you need to click on the advanced settings and change it from append to overwrite. As far as I know there's no way to change this after the copy job has been created.
I've always used a script task in a pipeline to truncate the table first, then run the copy job. I've found that to be more reliable.
Turns out, there is NO option to OVERWRITE when using a Copy Job that A) uses FULL Load and B) targets a Fabric Warehouse. (Missing functionality, IMHO). But if you select Incremental Load, there is an otpion to Reset that turns the NEXT run into a Full Load.
Microsoft could not have made this any more difficult to grasp from a user perspective. You can do an OVERWRITE if you send to a Lakehouse, but NOT a Warehouse.
Readers: Want better and more functionality from Copy Job? Vote on this item: Copy Job needs more functionality - Microsoft Fabric Community