Duplicate records when there are no duplicate records

[blestone111]

Hi Experts

My FACT table out of nowwhere is saying i have duplicate records (WHEN) there are no duplicate records in the SQL table and nor the table in Power BI. And this is stoping my Semantic Model from refreshing. 

I repeat there are no dups on the customer ID field. What could be casuing this??? HELP

[mussaenda]

Hi @blestone111 ,

Have you tried changing the customer ID field into integer then group them and do the count then sort in descending order? I am assuming here that Customer ID doesn't have any null or empty values.

[v-yiruan-msft]

Hi @blestone111 ,

Could you please confirm if the method Jai provided in his last reply resolved your issue? If not, could you provide the following information:

1. A screenshot of the error message.
2. Refresh all data and execute the "Remove Duplicates" operation for the FACT table in Power Query Editor. Then, check if the error persists after removing duplicate values.
3. Is there a relationship created between this FACT table and any other table? If yes, please provide the relationship info(cardinality, direction etc.)

Best Regards

[Jai-Rathinavel]

@blestone111 You might have blank , null values in your Customer ID field this will also cause the error you are facing since your fact table might be in the side of One on One to many relationship in your current data model. Can you double check that once by opening a new page and pulling the values in a table visual and sorting it ?

[blestone111]

Hi Jai - no blanks in the customer ID column.

[Jai-Rathinavel]

@blestone111 Can you pull in Customer ID and COUNT(Customer ID) in a new table and sort the count column. 

[blestone111]

Hi Jai - the coun is 1 no 2. 

[Jai-Rathinavel]

@blestone111  So you have duplicates ?

[blestone111]

No Dups... No count of 2 - just 1

[Jai-Rathinavel · Accepted solution]

@blestone111 Can you make your relationship Many to Many and again try switching back to One to Many. Now Power BI will highlight / prompt the value which are considered as duplicates.

Thanks,

Jai