Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
5 years ago
Solved

powerbi desktop remove duplicates

Iam getting data from two data sources one is folder and other one is website, i want to merge the two data sources and remove the duplicates.

  • In Power Query you want to Append the data. That will put one table on top of the other into one long table. That will require all column names be exactly the same before you do the append operation - including same case. . Then when done, just remove the duplicates by clicking on the little table button in the far upper left of the table.

    Note that Power Query is case sensitive, so make sure the data is the same case. If you have Apple and APPLE in the column, Power Query will not see those as duplicates. You might want to transform everything to lower or upper case.

     

  • Anonymous's avatar
    Anonymous
    5 years ago

    Anonymous 

    You can either use Merge or Append, depends how you want to combine them, merge is like join in SQL. 

     


    Paul Zheng _ Community Support Team

2 Replies

  • edhans's avatar
    edhans
    Community Champion

    In Power Query you want to Append the data. That will put one table on top of the other into one long table. That will require all column names be exactly the same before you do the append operation - including same case. . Then when done, just remove the duplicates by clicking on the little table button in the far upper left of the table.

    Note that Power Query is case sensitive, so make sure the data is the same case. If you have Apple and APPLE in the column, Power Query will not see those as duplicates. You might want to transform everything to lower or upper case.

     

  • Anonymous's avatar
    Anonymous
    Not applicable

    Anonymous 

    You can either use Merge or Append, depends how you want to combine them, merge is like join in SQL. 

     


    Paul Zheng _ Community Support Team