Forum Discussion

kdlfarm2007's avatar
kdlfarm2007
Regular Visitor
5 years ago
Solved

Duplicate values that do not exist?

Power BI: Duplicate Value Issue Hi All,   I've been getting 1 of 2 error messages when I try to refresh:   1) Data source error: Column 'PartNum' in Table 'job head part cost' contains a duplic...
Need Help
  • v-jingzhang's avatar
    v-jingzhang
    5 years ago

    Hi kdlfarm2007 

     

    To avoid losing anything, you can create a copy of the pbix file to troubleshoot this. In the copied file, remove all the relationships between tables 'job head part cost'/'Erp PartCost' and other tables, then try to refresh. If refreshing successfully without error, try Amit's suggestion to create a table visual to show the count of each number in Column 'PartNum' in each table. If there are duplicate values, their count numbers will be larger than 1.

     

    Additionally, do you execute any transformation on data to reduce rows in Power Query Editor? If not, you can also check the duplicate values at the data source side. If previous refreshings were all successful, this may be caused by newly added duplicate values at the data source side.

     

    A common cause is the upper/lower case of the values. Power BI Desktop is case insensitive in the model, which may lead to duplicate values when the data source is case sensitive.

     

    Regards,
    Community Support Team _ Jing
    If this post helps, please Accept it as the solution to help other members find it.

v-jingzhang's avatar
v-jingzhang
Community Support
5 years ago

Hi kdlfarm2007 

 

To avoid losing anything, you can create a copy of the pbix file to troubleshoot this. In the copied file, remove all the relationships between tables 'job head part cost'/'Erp PartCost' and other tables, then try to refresh. If refreshing successfully without error, try Amit's suggestion to create a table visual to show the count of each number in Column 'PartNum' in each table. If there are duplicate values, their count numbers will be larger than 1.

 

Additionally, do you execute any transformation on data to reduce rows in Power Query Editor? If not, you can also check the duplicate values at the data source side. If previous refreshings were all successful, this may be caused by newly added duplicate values at the data source side.

 

A common cause is the upper/lower case of the values. Power BI Desktop is case insensitive in the model, which may lead to duplicate values when the data source is case sensitive.

 

Regards,
Community Support Team _ Jing
If this post helps, please Accept it as the solution to help other members find it.

tsibilski's avatar
tsibilski
Advocate I
2 years ago

I had the same issue. You can't spot it in the Power Query. Counting rows in DAX shows the outlier. Solution: TRIM in Power Query.