Forum Discussion

icedavies's avatar
icedavies
Frequent Visitor
2 years ago
Solved

Removing Duplicates in Power Query based on X

Hi, I'm having a bit of trouble and hoping someone can help 🙂 I have a table with duplicates reference numbers in a column, lets call it "Ref Numbers". I also have another column which I will c...
Need Help
  • Anonymous's avatar
    Anonymous
    2 years ago

    Hi icedavies 

     

    In Power Query, select all the columns right-click and select the Remove Duplicates

    Then try this code:

     

    = Table.Group(#"Removed Duplicates", {"Ref Numbers"}, {{"Count", each if Table.RowCount(_) >1 then Table.SelectRows(_, each [Decider] = "RNS") else _ , type table }})

     

    Select the Decider in the  :

    The result is as follow:

     

     

    Best Regards

    Zhengdong Xu
    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

icedavies's avatar
icedavies
Frequent Visitor
2 years ago

Thanks Zhengdong Xu,

I have done what you have said and as I write this an hour after I have tried loading the data, Power BI is still loading the data.  I'm not sure how or why it is loading over 5.3GB of data. The file I'm loading from is not even 3MB.  Is there a reason why it's loading so much data?

 

 

Anonymous's avatar
Anonymous
Not applicable
2 years ago

Hi icedavies 

 

No, this is not normal, and executing this code does not increase memory.

Maybe you can close it and reload it again.

 

Best Regards

Zhengdong Xu
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

  • icedavies's avatar
    icedavies
    Frequent Visitor
    2 years ago

    Thanks Zhengdong Xu,  I think it was me causing the issue but it's resolved now.
    Thank you so much for your help, I was stuck on this for days!