powerbi desktop remove duplicates

[Anonymous]

Iam getting data from two data sources one is folder and other one is website, i want to merge the two data sources and remove the duplicates.

[edhans · Accepted solution]

In Power Query you want to Append the data. That will put one table on top of the other into one long table. That will require all column names be exactly the same before you do the append operation - including same case. . Then when done, just remove the duplicates by clicking on the little table button in the far upper left of the table.

Note that Power Query is case sensitive, so make sure the data is the same case. If you have Apple and APPLE in the column, Power Query will not see those as duplicates. You might want to transform everything to lower or upper case.

[Anonymous · Accepted solution]

@Anonymous 

You can either use Merge or Append, depends how you want to combine them, merge is like join in SQL. 

Paul Zheng _ Community Support Team

[edhans · Accepted solution]

In Power Query you want to Append the data. That will put one table on top of the other into one long table. That will require all column names be exactly the same before you do the append operation - including same case. . Then when done, just remove the duplicates by clicking on the little table button in the far upper left of the table.

Note that Power Query is case sensitive, so make sure the data is the same case. If you have Apple and APPLE in the column, Power Query will not see those as duplicates. You might want to transform everything to lower or upper case.