Advance your Data & AI career with 50 days of live learning, dataviz contests, hands-on challenges, study groups & certifications and more!
Get registeredGet Fabric Certified for FREE during Fabric Data Days. Don't miss your chance! Request now
Hello all,
I have prepared the powerbi file where I get data from SharePoint and SQL server.
Tables have been merged based on 3 different columns.
I use this powerbi file on different projects. (made the "project ID" variable, so each time when I want to move to another project just change the project id in the power query).
Almost all projects contain duplicates so when I shift to a new project powerbi pops up a notification for one duplicate at a time(only after I remove the existing one, another notification comes around).
Is there any way, to avoid the notification of the duplicates at all? Just to proceed even if there are some duplicates and providing all duplicates in a separate list?
Hi @Anonymous
Can you please show the duplicate notification you received? Do you have any transformation or data modeling operation which requires a unique column in the table? Usually when a column is on the one-side of a relationship, it will pop up error message when applying data to the model if this column has duplicated values.
Best Regards,
Community Support Team _ Jing
.In powerbi file, i get data from 2 sources( Sharepoint and SQL server).
I have merged tables from both sources in powerquery. Merging done by unique column. However, there are sometimes duplicates in the column from the SQL server.
The question is that, even if there are duplicates, is it possible to avoid notification(error which says there is a duplicate) and run the query.
Deduplicate the SQL source in Power Query before you merge the sources. Better yet, don't merge them in Power Query. Let the data model do the work for you.
Thanks for the Advice!
Even when I merge data in powerquery I see that in data model relationship is different(done on its own).
For now, I have filtered SQL table, so do not get duplicates so far. For future cases, look forward to find more optimal solution to deal with them.
Please provide a more detailed explanation of what you are aiming to achieve. What have you tried and where are you stuck?
Sure. In powerbi file, i get data from 2 sources( Sharepoint and SQL server).
I have merged tables from both sources in powerquery. There are usually duplicates from the SQL server.
The question is that, even if there are duplicates, is it possible to avoid notification(error which says there is a duplicate) and run the query.
Check out the November 2025 Power BI update to learn about new features.
Advance your Data & AI career with 50 days of live learning, contests, hands-on challenges, study groups & certifications and more!
| User | Count |
|---|---|
| 7 | |
| 7 | |
| 7 | |
| 4 | |
| 4 |
| User | Count |
|---|---|
| 19 | |
| 14 | |
| 14 | |
| 10 | |
| 9 |