Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Enhance your career with this limited time 50% discount on Fabric and Power BI exams. Ends August 31st. Request your voucher.

Reply
rohan_27
New Member

Power bi refresh failed due to duplicates in source

Hi,

 

Power bi refresh has failed(since 4th sep) due to duplicates in source. Below is the error screenshot :-

56d7943b-b24d-44d3-98dd-d061acfdce66.PNG

The data flow is :- AZURE SQL DB --> Snowflake (Through pipeline) --> Power BI.
In db, when checked for below records in respective tables, it is showing only 1 record in form table..

 

b60e9c1a-3a6a-4c00-8bca-8c06ab2a6a89.PNG

and 3 records in personnel table with 3 unique ids for same email id..

156f9813-94d6-4078-a9eb-0b573582a5d6.PNG

When checked with our B.Analyst, he replied it is possible that with 1 email id, there can be multiple users can access the learning portal and same is captured in db. The database and snowflake is working fine with this logic, but power bi is failing. He told power bi must accept this duplicates.
But when checked in power BI for form table's query, it is having only 1 record..

c839e03f-12c8-4b95-af69-de23da8ee6f8.PNG

..still in power bi service, it is showing duplicate issue.
So how to deal with this issue?
How to allow power bi to allow this duplicates?

 

Note :- The gateway to which power bi is connected has some issues..

4fafce0d-85a7-415b-ae1f-1a1a4ec99673.PNG

 ..so this duplicate issue may be due to this gateway failure, because the timing of power bi failure (duplicate issue) and  this gateway is same.
If not this gateway, then how to deal with this issue ?

1 ACCEPTED SOLUTION
Idrissshatila
Super User
Super User

Hello @rohan_27 ,

 

you need to check it in power bi in the power query level because it's not imported yet and won't import if the relationship one to many is active, so go to power query and check it there, you should see it.



Did I answer your question? Mark my post as a solution! Appreciate your Kudos
Follow me on LinkedIn linkedIn
Vote for my Community Mobile App Idea

Proud to be a Super User!




View solution in original post

2 REPLIES 2
rohan_27
New Member

Yes sure

 

Idrissshatila
Super User
Super User

Hello @rohan_27 ,

 

you need to check it in power bi in the power query level because it's not imported yet and won't import if the relationship one to many is active, so go to power query and check it there, you should see it.



Did I answer your question? Mark my post as a solution! Appreciate your Kudos
Follow me on LinkedIn linkedIn
Vote for my Community Mobile App Idea

Proud to be a Super User!




Helpful resources

Announcements
July PBI25 Carousel

Power BI Monthly Update - July 2025

Check out the July 2025 Power BI update to learn about new features.

Join our Fabric User Panel

Join our Fabric User Panel

This is your chance to engage directly with the engineering team behind Fabric and Power BI. Share your experiences and shape the future.

June 2025 community update carousel

Fabric Community Update - June 2025

Find out what's new and trending in the Fabric community.