Forum Discussion
Data Refresh Fails, Error message claims duplicate ID value in table
We have about 20 Power BI app workspaces scheduled to refresh on a regular bases... we get the false duplicate error message about 1 in every 100 refreshes. For those with the false duplicate error reported, we perform a manual on-demand refresh from the service and this solves the false reported duplicate 100% of the times.
It has been confirmed as a "false" duplicate error, but must be some other error.
Maybe its something to do with not clearing the table completely before reloading.
We have also seen the same behavior with PBI desktop, and again just doing another immediate refresh the reported duplicate is gone. Weird
Can you give more information on "we perform a manual on-demand refresh from the service and this solves the false reported duplicate 100% of the times."
I am having the same issue and need to try this, but I am not sure what to do. Thanks.
I should NOT have said it solves the problem... it just proves that there is not really a duplicate ID 100% of the time.
The problem is still happening for us and how at a much greater frequency.
Can confirm this is still an issue, started facing this recently. Also confirmed the source data has no duplicates at all, when this error pops up, in 99% of cases just re-doing the refresh makes it go away. Definitely a bug where the string matching routine within PBI thinks something is a dup, when in reality it isn't
For a workaround, please see below
https://exceleratorbi.com.au/preventing-managing-refresh-failures-in-power-bi/
