Recurrent BUG with presence of duplicate which blocks the update

[IHOUM]

Hi everyone, 



For several months, I have a problem when powerBI automatically refreshes reports with incremental refresh.

From time to time the refresh fails because a duplicate data is found in a table, but this duplicate is not possible in the relation schema, even when I add a remove duplicates step in power query. (the duplicate is never the same) 

From then on, all the next updates will fail on the same message until PowerBi stops scheduled updates by itself. To solve the problem, I open the report in desktop, I refresh the data. I never encounter the above-named duplicate then I publish the report to the service, and the automatic refresh resumes without problem.

I was maybe thinking about the fact that there is a very large number of updates using the same gateway at the same time because on my workspace there is an update every hour.


Have you ever encountered this kind of problem, and if so, how to solve it?



 

[IHOUM]

Hi @Anonymous;

I've already checked all this steps and unfortunately the issue is still the same. I've contacted the power bi support and I am waiting for their reply.

[Anonymous]

Hi @IHOUM ,

Please have a try.

1. Check your data source - make sure that there are no duplicates in the data source itself. You may need to clean up the data before importing it into Power BI.

2. Check your relationships - make sure that the relationships between your tables are set up correctly and that there are no circular references or other issues.

3. Check your incremental refresh settings - make sure that your incremental refresh settings are configured correctly and that you are not inadvertently including duplicate data.

4. Try refreshing the data manually - if you're still having issues, try refreshing the data manually to see if you can identify any specific issues or errors.

How to Get Your Question Answered Quickly 

If it does not help, please provide more details .

Best Regards
Community Support Team _ Rongtie

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.