The ultimate Fabric, Power BI, SQL, and AI community-led learning event. Save €200 with code FABCOMM.
Get registeredEnhance your career with this limited time 50% discount on Fabric and Power BI exams. Ends August 31st. Request your voucher.
Hi, could anyone please clarify on why the data comes repeatedly while I choose overwrite in data pipeline? Overwrite shouldn't give duplicate isn't it?
You are using the "Copy data" activity and your destination is a table in a lakehouse?
I think the "overwrite" should not create duplicate data.
How do the numbers of rows compare from your source data to your destination table? Do you see an integer multiplier, like 2x or 3x as many records in your destination table, meaning all of your rows are being duplicated? Or do only some rows get duplicated?
Are you doing anything with schemas? Or leaving the destination table in the dbo schema?