Forum Discussion
Copy data activity not overwriting
We have pipelines that have been running for months without issue. Overnight some copy data activities from lakehouse to lakehouse are now appending rather than overwriting data. The copy data activi...
I ended up creating a notebook to purge tables. Probably that is the way that it was intended to happen (still the question on why Overwrite option exits in data pipeline copy process.
During the MS Fabric Conference (It was great, and if you didn't join one of these yet, please make sure you do!), I tested this with a MS Data Factory person, and the overwrite worked well! It could be something temporary that happened in August, and now in September it worked fine as expected, overwriting and not appending.
This message prompted me to retest this quickly, and it does appear that the bug has been fixed.
