Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Earn a 50% discount on the DP-600 certification exam by completing the Fabric 30 Days to Learn It challenge.

Reply
Raj_030
New Member

Hiw to implement check points in my existing design to avoid duplicates in sinkin ADF

Hi,

In adf one of the data flow is failed due to transist error in the middle of execution.the data flow is having insert ,update and delete operation based on scd2 scenario.To avoid the transist failures we have applied retry option.But while retrying second attempt there is some data loaded in the sink table already in the first attempt and causes duplicate records in the table during the second run for insert scenario.Is there any option to restart the job from the point of failure during the second retry.

  •  

I have not implemented cdc at source level that's the reason it seems I did not see any option at sink setting about check points to avoid duplicate Dara.

 

Please suggest.

 

Thanks in advance.

 

1 ACCEPTED SOLUTION
v-gchenna-msft
Community Support
Community Support

Hi @Raj_030 ,

Thanks for using Fabric Community.
At this time we handle only Fabric related issues. As the above ask is related to Azure Data Factory, I request you to open a new ticket here - Ask a question - Microsoft Q&A
You would get a better help if you can open a ticket in above mentioned platform.

Hope this is helpful.

View solution in original post

1 REPLY 1
v-gchenna-msft
Community Support
Community Support

Hi @Raj_030 ,

Thanks for using Fabric Community.
At this time we handle only Fabric related issues. As the above ask is related to Azure Data Factory, I request you to open a new ticket here - Ask a question - Microsoft Q&A
You would get a better help if you can open a ticket in above mentioned platform.

Hope this is helpful.

Helpful resources

Announcements
RTI Forums Carousel3

New forum boards available in Real-Time Intelligence.

Ask questions in Eventhouse and KQL, Eventstream, and Reflex.

MayFabricCarousel

Fabric Monthly Update - May 2024

Check out the May 2024 Fabric update to learn about new features.

LearnSurvey

Fabric certifications survey

Certification feedback opportunity for the community.