topic HELP::COPY DATA::APPEND MODE in Pipelines

HELP::COPY DATA::APPEND MODE

Element115 — Tue, 09 Apr 2024 17:31:29 GMT

In the following screenshot of the Copy data settings UI, the info bubble that appears upon hovering on the Table action ---> Append radio button says:

'Append new values to existing table'

QUESTION:

Does this mean that the Copy data activity is performing an implicit incremental copy? Copy only values that are new, thus it checks the existing table in the lakehouse and copies only those values from source that are not yet in the lakehouse? Or not?

Re: HELP::COPY DATA::APPEND MODE

Element115 — Tue, 09 Apr 2024 20:49:31 GMT

Using the SQL endpoint, I answered my own question: Append mode creates duplicate rows. So incremental load needs to be implemented by the user.

Re: HELP::COPY DATA::APPEND MODE

Anonymous — Thu, 11 Apr 2024 07:46:42 GMT

Glad to know you were able to find answer for your query.