Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Get certified as a Fabric Data Engineer: Check your eligibility for a 50% exam voucher offer and join us for free live learning sessions to get prepared for Exam DP-700. Get started

Reply
Raj_030
New Member

Hiw to implement check points in my existing design to avoid duplicates in sinkin ADF

Hi,

In adf one of the data flow is failed due to transist error in the middle of execution.the data flow is having insert ,update and delete operation based on scd2 scenario.To avoid the transist failures we have applied retry option.But while retrying second attempt there is some data loaded in the sink table already in the first attempt and causes duplicate records in the table during the second run for insert scenario.Is there any option to restart the job from the point of failure during the second retry.

  •  

I have not implemented cdc at source level that's the reason it seems I did not see any option at sink setting about check points to avoid duplicate Dara.

 

Please suggest.

 

Thanks in advance.

 

1 ACCEPTED SOLUTION
Anonymous
Not applicable

Hi @Raj_030 ,

Thanks for using Fabric Community.
At this time we handle only Fabric related issues. As the above ask is related to Azure Data Factory, I request you to open a new ticket here - Ask a question - Microsoft Q&A
You would get a better help if you can open a ticket in above mentioned platform.

Hope this is helpful.

View solution in original post

1 REPLY 1
Anonymous
Not applicable

Hi @Raj_030 ,

Thanks for using Fabric Community.
At this time we handle only Fabric related issues. As the above ask is related to Azure Data Factory, I request you to open a new ticket here - Ask a question - Microsoft Q&A
You would get a better help if you can open a ticket in above mentioned platform.

Hope this is helpful.

Helpful resources

Announcements
Feb2025 Sticker Challenge

Join our Community Sticker Challenge 2025

If you love stickers, then you will definitely want to check out our Community Sticker Challenge!

JanFabricDE_carousel

Fabric Monthly Update - January 2025

Explore the power of Python Notebooks in Fabric!

JanFabricDW_carousel

Fabric Monthly Update - January 2025

Unlock the latest Fabric Data Warehouse upgrades!