https://community.fabric.microsoft.com/t5/Pipelines/About-overwrite-in-pipeline/m-p/4100978#M4989 <P>Hi, could anyone please clarify on why the data comes repeatedly while I choose overwrite in data pipeline? Overwrite shouldn't give duplicate isn't it?</P> Wed, 14 Aug 2024 20:51:45 GMT PEPP 2024-08-14T20:51:45Z https://community.fabric.microsoft.com/t5/Pipelines/About-overwrite-in-pipeline/m-p/4100978#M4989 <P>Hi, could anyone please clarify on why the data comes repeatedly while I choose overwrite in data pipeline? Overwrite shouldn't give duplicate isn't it?</P> Wed, 14 Aug 2024 20:51:45 GMT https://community.fabric.microsoft.com/t5/Pipelines/About-overwrite-in-pipeline/m-p/4100978#M4989 PEPP 2024-08-14T20:51:45Z https://community.fabric.microsoft.com/t5/Pipelines/About-overwrite-in-pipeline/m-p/4101107#M4991 <P>You are using the "Copy data" activity and your destination is a table in a lakehouse?</P><P>&nbsp;</P><P>I think the "overwrite" should not create duplicate data.</P><P>&nbsp;</P><P>How do the numbers of rows compare from your source data to your destination table? Do you see an integer multiplier, like 2x or 3x as many records in your destination table, meaning all of your rows are being duplicated? Or do only some rows get duplicated?</P><P>&nbsp;</P><P>Are you doing anything with schemas? Or leaving the destination table in the dbo schema?</P> Wed, 14 Aug 2024 22:59:08 GMT https://community.fabric.microsoft.com/t5/Pipelines/About-overwrite-in-pipeline/m-p/4101107#M4991 mikeburek 2024-08-14T22:59:08Z