Forum Discussion
Append Queries and Remove Duplicate
- Anonymous1 year ago
Hi VoltesDev,
Thanks for reaching out to the Microsoft fabric community forum.
It looks like you are unable to create reference between tables but because of duplicate values you are unable to do so. I tried to recreate your scenario with a sample data where I followed your steps of :
* Creating a custom column and removing all other columns:
* Appending the first table on second table:
* After appending removing all the duplicates:
After following all the steps, ensure there is no hidden duplicate value by checking for Null Values.
* Click on the filter icon in custom column created. If you see NULL, remove it by unchecking NULL.
* Check for hidden duplicates by using "Group By". On Transform pane select group by and then select the custom
column. In New column put "count" and set it to "count rows" and "OK".
After this you will see a new column with count as 1. If count > 1, then duplicates still exists.
* In model view I was able create reference with my appended table (table2 Ref)
Try to cross check for any duplicates before loading the data from Power Query to PowerBi Desktop.
If I misunderstand your needs or you still have problems on it, can you please elaborate more and provide some sample data so that our community members can reproduce the scenario and come up with the best possible solution.
I would also take a moment to thank Akash_Varuna, for actively participating in the community forum and for the solutions you’ve been sharing in the community forum. Your contributions make a real difference.
Best Regards,
Hammad.
Community Support TeamIf this post helps then please mark it as a solution, so that other members find it more quickly.
Thank you.
Hi VoltesDev , I think the issue arises because of "Remove Duplicates" is applied before the append please do try these steps
- After appending the two tables, apply Remove Duplicates again on the appended result, not just on individual tables before appending.
- Double-check the concatenated values for any hidden differences hat might prevent rows from being recognized as duplicates.
If this post helped please do give a kudos and accept this as a solution
Thanks In Advance