Forum Discussion

waltheed's avatar
waltheed
Icon for Impactful Individual rankImpactful Individual
3 years ago
Solved

Fabric Data Factory Pipeline: Incremental load

How can I create an incremental load in Data Factory Pipeline?   I only see the Table Actions append or overwrite. But I want to be able to add new rows, update existing ones and mark deleted rows....
Need Help
pipelines
  • ajarora's avatar
    ajarora
    3 years ago

    Your table action options imply that you are using pipelines. If so, good news, we have just added a new feature that allows you to "upsert" the new rows into existing tables instead of append/overwrite only.

    Its in private preview, please ping me with your workspace id, and we can enable it for you along with instructions. cc makromer 

ajarora's avatar
ajarora
Icon for Microsoft Employee rankMicrosoft Employee
3 years ago

Your table action options imply that you are using pipelines. If so, good news, we have just added a new feature that allows you to "upsert" the new rows into existing tables instead of append/overwrite only.

Its in private preview, please ping me with your workspace id, and we can enable it for you along with instructions. cc makromer 

sergs's avatar
sergs
Icon for Advocate I rankAdvocate I
3 years ago

Hi

I've pm'ed you our workspacec id. Would you be able to enable the preview feature? We're evaluating different options at the moment and it's one of the requirements to have incremental load.

Thanks!