Forum Discussion

VoltesDev's avatar
VoltesDev
Helper V
1 year ago
Solved

Append Queries and Remove Duplicate

Hi,   I have two queries added in Power Query, and at each of the table, added custom column with value of concate few fields, like this: #"Added Custom" = Table.AddColumn(#"Changed Type", "dist...
  • Anonymous's avatar
    Anonymous
    1 year ago

    Hi VoltesDev,

    Thanks for reaching out to the Microsoft fabric community forum.

     

    It looks like you are unable to create reference between tables but because of duplicate values you are unable to do so. I tried to recreate your scenario with a sample data where I followed your steps of :

    * Creating a custom column and removing all other columns:

    * Appending the first table on second table:

    * After appending removing all the duplicates:

    After following all the steps, ensure there is no hidden duplicate value by checking for Null Values.

    * Click on the filter icon in custom column created. If you see NULL, remove it by unchecking NULL.

    * Check for hidden duplicates by using "Group By". On Transform pane select group by and then select the custom

       column. In New column put "count" and set it to "count rows" and "OK".

    After this you will see a new column with count as 1. If count > 1, then duplicates still exists.

    * In model view I was able create reference with my appended table (table2 Ref)

    Try to cross check for any duplicates before loading the data from Power Query to PowerBi Desktop.

     

    If I misunderstand your needs or you still have problems on it, can you please elaborate more and provide some sample data so that our community members can reproduce the scenario and come up with the best possible solution.  

     

    I would also take a moment to thank Akash_Varuna, for actively participating in the community forum and for the solutions you’ve been sharing in the community forum. Your contributions make a real difference.

     

    Best Regards,
    Hammad.
    Community Support Team

     

    If this post helps then please mark it as a solution, so that other members find it more quickly.

    Thank you.