Forum Discussion

Awollet33's avatar
Awollet33
Helper I
4 years ago
Solved

Incremental Refresh Error

Hi Power BI community,   I want to apply incremental refreshes but I am having some problems. Firstly, I am getting this error message saying I have duplicate values and I have confirmed I do not h...
  • Anonymous's avatar
    Anonymous
    4 years ago

    Hi Awollet33 ,

     

    Try the solution from official document.

    Cause: Post dates have changed

    With a refresh operation, only data that has changed at the data source is refreshed in the dataset. As the data is divided by a date, it’s recommended post (transaction) dates are not changed.

    If a date is changed accidentally, then two issues can occur: Users notice some totals changed in the historical data (that is not supposed to happen), or during a refresh an error is returned indicating a unique value is not in fact unique. For the latter, this can happen when the table with incremental refresh configured is used in a 1:N relationship with another table as the 1 side and should have unique values. When the data is changed (for a specific ID), that ID then appears in another partition and the engine will detect the value is not unique.

    Solution: Refresh specific partitions

    Where there is a business need to change some past data from the dates, a possible solution is to use SSMS to refresh all partitions from the point where the change is located up to the current refresh partition, thus keeping the 1 side of the relationship unique.

    https://docs.microsoft.com/en-us/power-bi/connect-data/incremental-refresh-troubleshoot#problem-refresh-fails-because-of-duplicate-values 

     

    Best Regards,

    Jay