Forum Discussion
Table Merge creates duplicate records
The problem lay with the Data.
The LEFT JOIN functionality of PowerBI works perfectly.
I got the same problem.
Source table is an daily order table with duplicated rows, i.e. SKU ID and merged with another matching table with unique rows of SKU ID, and created randomly duplicated rows.
Whatever I tried to remove duplicates or aggregated by median still not get the correct final data.
My order data could get up to 20K rows and it's easily get wrong while I merged the tables.
That is so annoying.
Hope POWER BI experts can really solve this problem.
Thanks.
I know this post is old, but this may help others in the future:
Create an Index Column before the merging.
This will mark each row with a unique sequential number.
When the duplicate happens, it will duplicate the number as well.
After the merging, select the Index Column and remove duplicates.
Remove Index column.
Thank you, this is the only thing that worked for me! The index also makes it easy to spot where data has been deleted eronously. I plan on added one to all of my datasets from now on.
