Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Learn from the best! Meet the four finalists headed to the FINALS of the Power BI Dataviz World Championships! Register now

Reply
Petanek333
Helper III
Helper III

Unknown duplicate error when refreshing dataset

Hi,

I get an error during a refresh. I get data from an Excel file and a message about duplicate value appears, see below.

Problem is, there is no duplicate value in column Product ID in Table OKAY CZ. Did you deal with this kind of message? Is there any solution? Am I missing something?

There is a relationship between the Product ID column in the mentioned table OKAY CZ and in another table. But those two columns in different tables are identical with the same count of rows. 

chyba Power BI.png

1 ACCEPTED SOLUTION
BA_Pete
Super User
Super User

Hi @Petanek333 ,

 

Go to your OKAY CZ query, select the [Product ID] column and go to

Home tab > Remove Rows (dropdown) > Remove Blank Rows

Home tab > Remove Rows (dropdown) > Remove Duplicates

Try and apply changes.

 

Let me know how you get on.

 

Pete



Now accepting Kudos! If my post helped you, why not give it a thumbs-up?

Proud to be a Datanaut!




View solution in original post

5 REPLIES 5
ptpaton
Frequent Visitor

Error occurred when I tried to convert from direct query to import.  Duplicate values on a column that was an identity column used as a primary key in SQL server, so I knew there were no nulls or duplicates.  The duplicates were created because I merged a query and expanded a column.  Apparently direct query can handle this but import can't.  Removed the expanded column, converted to import, remerged the query and reexpanded the column did the trick.

Petanek333
Helper III
Helper III

Thank you guys for the solutions. Those from @BA_Pete  and @Anonymous worked well together. 

Anonymous
Not applicable

Hi @Petanek333 ,

 

Go to the model view and open 'Manage Relationships'. Delete the relationship with error and refresh again.

Below I reproduce your problem.

vstephenmsft_0-1645516998167.png

In the Manage Relationships, find the relationship with error and delete it.

vstephenmsft_1-1645517099426.png

vstephenmsft_2-1645517108548.png

Then it will refresh successfully.

 

 

Best Regards,

Stephen Tao

 

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

 

Anonymous
Not applicable

Also, make sure you trim and UPPERCASE that column! If you load an otherwise identical value as lowercase, Power Query will keep it, but the data model will flag it as a duplicate. 

BA_Pete
Super User
Super User

Hi @Petanek333 ,

 

Go to your OKAY CZ query, select the [Product ID] column and go to

Home tab > Remove Rows (dropdown) > Remove Blank Rows

Home tab > Remove Rows (dropdown) > Remove Duplicates

Try and apply changes.

 

Let me know how you get on.

 

Pete



Now accepting Kudos! If my post helped you, why not give it a thumbs-up?

Proud to be a Datanaut!




Helpful resources

Announcements
New to Fabric survey Carousel

New to Fabric Survey

If you have recently started exploring Fabric, we'd love to hear how it's going. Your feedback can help with product improvements.

Power BI DataViz World Championships carousel

Power BI DataViz World Championships - June 2026

A new Power BI DataViz World Championship is coming this June! Don't miss out on submitting your entry.

Join our Fabric User Panel

Join our Fabric User Panel

Share feedback directly with Fabric product managers, participate in targeted research studies and influence the Fabric roadmap.

March Power BI Update Carousel

Power BI Community Update - March 2026

Check out the March 2026 Power BI update to learn about new features.