Forum Discussion

aleggore's avatar
aleggore
Frequent Visitor
4 years ago
Solved

Duplicate values

I am finding duplicate values in my dataset after I try to refresh. There are no duplicate values showing when I run my query independently or in Power Query before I load to PowerBI. Has anyone seen this happen before and know of any resolution? 

  • power query doesnt load all the data since its just load a sample data for you to see the tranformation you doing, when you apply the query power bi desktop does pull all the data from the source, so probably there its some duplicate on the source data, or a tranformation you applying its generating the duplicate (this can be the case happends frenquently over merge or append steps)

2 Replies

  • power query doesnt load all the data since its just load a sample data for you to see the tranformation you doing, when you apply the query power bi desktop does pull all the data from the source, so probably there its some duplicate on the source data, or a tranformation you applying its generating the duplicate (this can be the case happends frenquently over merge or append steps)

  • v-luwang-msft's avatar
    v-luwang-msft
    Community Support

    Hi aleggore ,

    Please check if your steps include the following.

    I created the file containing the duplicate data for testing and after importing it, the duplicates did not disappear, you can use my file for testing.

    Best Regards

    Lucien