Forum Discussion
Power bi refresh failed due to duplicates in source
Hi,
Power bi refresh has failed(since 4th sep) due to duplicates in source. Below is the error screenshot :-
The data flow is :- AZURE SQL DB --> Snowflake (Through pipeline) --> Power BI.
In db, when checked for below records in respective tables, it is showing only 1 record in form table..
and 3 records in personnel table with 3 unique ids for same email id..
When checked with our B.Analyst, he replied it is possible that with 1 email id, there can be multiple users can access the learning portal and same is captured in db. The database and snowflake is working fine with this logic, but power bi is failing. He told power bi must accept this duplicates.
But when checked in power BI for form table's query, it is having only 1 record..
..still in power bi service, it is showing duplicate issue.
So how to deal with this issue?
How to allow power bi to allow this duplicates?
Note :- The gateway to which power bi is connected has some issues..
..so this duplicate issue may be due to this gateway failure, because the timing of power bi failure (duplicate issue) and this gateway is same.
If not this gateway, then how to deal with this issue ?
Hello rohan_27 ,
you need to check it in power bi in the power query level because it's not imported yet and won't import if the relationship one to many is active, so go to power query and check it there, you should see it.
2 Replies
- Idrissshatila
Super User
Hello rohan_27 ,
you need to check it in power bi in the power query level because it's not imported yet and won't import if the relationship one to many is active, so go to power query and check it there, you should see it.
- rohan_27New Member
Yes sure