Forum Discussion
Incremental refresh is duplicating the records
Hi,
One of my Power bi report [Sales report] is updating with duplicate records on refresh.
I have disabled the incremental refresh and refreshed manually, but the records are duplicated.
Hi shamnadkalathil ,
According to your description, your incremental refresh data was duplicated after the refresh was performed. This may be due to the duplication of the parameter range you set, e.g. if the start time is set to greater than or equal to, then the end time should be set to less than. If the entire interval is in a closed interval, it will cause the first and last two times to overlap, thus refreshing the duplicate.
Also, do not change the refresh period and time column after the initial incremental refresh is set.
You can change this by referring to the description in the documentation in the following postSolved: Incremental refresh doubles my data - Microsoft Fabric Community
Configure incremental refresh and real-time data for Power BI semantic models - Power BI | Microsoft Learn
Solved: Incremental Refresh - Duplicate Rows for Refresh W... - Microsoft Fabric CommunityBest regards,
Albert HeIf this post helps, then please consider Accept it as the solution to help the other members find it more quickly
3 Replies
- Idrissshatila
Super User
Hello shamnadkalathil .
I don't think it's related to incremental refresh, check if you're merging with another table through a field that has duplicates, this will duplicate your data.
check the number of rows before certain steps to get to know which step is causing the duplication.
Hi Idrissshatila , thank you for the reply.
I have unchecked the option "autodetect new relationships after data is loaded".
Is this maybe the issue?
Hi shamnadkalathil ,
According to your description, your incremental refresh data was duplicated after the refresh was performed. This may be due to the duplication of the parameter range you set, e.g. if the start time is set to greater than or equal to, then the end time should be set to less than. If the entire interval is in a closed interval, it will cause the first and last two times to overlap, thus refreshing the duplicate.
Also, do not change the refresh period and time column after the initial incremental refresh is set.
You can change this by referring to the description in the documentation in the following postSolved: Incremental refresh doubles my data - Microsoft Fabric Community
Configure incremental refresh and real-time data for Power BI semantic models - Power BI | Microsoft Learn
Solved: Incremental Refresh - Duplicate Rows for Refresh W... - Microsoft Fabric CommunityBest regards,
Albert HeIf this post helps, then please consider Accept it as the solution to help the other members find it more quickly
