cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
campelliann
Post Patron
Post Patron

PowerBI Service throwing Duplicate error

Hi there,


PowerBIservice keeps failing the schedule refresh with the below error, although we dont have any duplicates on the table. After clearing the cache it seemed the issue was resolved, but then it came back. 

Any ideas?

 

 

 

Column '<ccon>Id</ccon>' in Table '<ccon>Tickets</ccon>' contains a duplicate value '<ccon>2016</ccon>' and this is not allowed for columns on the one side of a many-to-one relationship or for columns that are used as the primary key of a table.

2 REPLIES 2
Sahir_Maharaj
Community Champion
Community Champion

Hello @campelliann,

 

Here are some steps you can take to address this issue:

  1. Verify the data: Double-check the data in the 'Id' column of the 'Tickets' table. Ensure that there are no duplicates or conflicting values. Look for any inconsistencies or discrepancies that might be causing the error.

  2. Check relationships: Examine the relationships between the 'Tickets' table and other tables in your data model. Confirm that the 'Id' column is correctly used as the foreign key in any many-to-one relationships. If the 'Id' column is involved in relationships, ensure that the relationships are defined correctly and that the data aligns with the relationship requirements.

  3. Check primary key constraints: If the 'Id' column is used as the primary key in the 'Tickets' table, ensure that there are no duplicate values in the column. Additionally, verify that the primary key constraints are properly set in your database.

  4. Clear cache and refresh: Since clearing the cache temporarily resolved the issue, try clearing the cache again and then refresh the data. Sometimes, cached data or artifacts can cause conflicts, so clearing the cache can help refresh the data and potentially resolve the error.

  5. Check data source: If you are connecting to an external data source, such as a database, make sure that the data in the source itself does not contain any duplicates in the 'Id' column. Verify the integrity of the data directly in the data source to rule out any issues from the source itself.

  6. Rebuild relationships: In case the issue persists, consider rebuilding the relationships between tables from scratch. Remove all existing relationships and recreate them based on the correct column mappings and cardinality.

  7. Split the query: If you are loading data using a complex query or multiple tables, consider splitting the query or loading the data in stages. This approach can help identify which specific part of the query or table is causing the issue. You can then isolate and resolve the problem area.

Let me know if you might need further assistance.


Did I answer your question? Mark my post as a solution, this will help others!  

If my response(s) assisted you in any way, don't forget to drop me a "Kudos" 🙂

Kind Regards,
Sahir Maharaj
P.S. Want me to build your Power BI solution?
Data Scientist | Data Engineer | Data Analyst | AI Engineer

➤ Website: https://sahirmaharaj.com

➤ Email: sahir@sahirmaharaj.com

➤ Lets connect on LinkedIn: Join my network of 12K+ professionals

➤ Want me to build your Power BI solution? Lets chat about how I can assist!

➤ Join my Medium community of 30k readers! Sharing my knowledge about data science and artificial intelligence


Hi there, Thank you for your detailed answer. Could incremental refresh be the cause? At least the problem started with it...

Helpful resources

Announcements
PBI Sept Update Carousel

Power BI September 2023 Update

Take a look at the September 2023 Power BI update to learn more.

Learn Live

Learn Live: Event Series

Join Microsoft Reactor and learn from developers.

Dashboard in a day with date

Exclusive opportunity for Women!

Join us for a free, hands-on Microsoft workshop led by women trainers for women where you will learn how to build a Dashboard in a Day!

MPPC 2023 PBI Carousel

Power Platform Conference-Power BI and Fabric Sessions

Join us Oct 1 - 6 in Las Vegas for the Microsoft Power Platform Conference.

Top Solution Authors