Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Calling all Data Engineers! Fabric Data Engineer (Exam DP-700) live sessions are back! Starting October 16th. Sign up.

Reply
PEPP
New Member

About overwrite in pipeline

Hi, could anyone please clarify on why the data comes repeatedly while I choose overwrite in data pipeline? Overwrite shouldn't give duplicate isn't it?

1 REPLY 1
mikeburek
Advocate II
Advocate II

You are using the "Copy data" activity and your destination is a table in a lakehouse?

 

I think the "overwrite" should not create duplicate data.

 

How do the numbers of rows compare from your source data to your destination table? Do you see an integer multiplier, like 2x or 3x as many records in your destination table, meaning all of your rows are being duplicated? Or do only some rows get duplicated?

 

Are you doing anything with schemas? Or leaving the destination table in the dbo schema?

Helpful resources

Announcements
FabCon Global Hackathon Carousel

FabCon Global Hackathon

Join the Fabric FabCon Global Hackathon—running virtually through Nov 3. Open to all skill levels. $10,000 in prizes!

September Fabric Update Carousel

Fabric Monthly Update - September 2025

Check out the September 2025 Fabric update to learn about new features.

FabCon Atlanta 2026 carousel

FabCon Atlanta 2026

Join us at FabCon Atlanta, March 16-20, for the ultimate Fabric, Power BI, AI and SQL community-led event. Save $200 with code FABCOMM.