Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Power BI is turning 10! Let’s celebrate together with dataviz contests, interactive sessions, and giveaways. Register now.

Reply
shamnadkalathil
Frequent Visitor

Incremental refresh is duplicating the records

Hi,

One of my Power bi report [Sales report] is updating with duplicate records on refresh.

I have disabled the incremental refresh and refreshed manually, but the records are duplicated.

1 ACCEPTED SOLUTION
Anonymous
Not applicable

Hi @shamnadkalathil ,
According to your description, your incremental refresh data was duplicated after the refresh was performed. This may be due to the duplication of the parameter range you set, e.g. if the start time is set to greater than or equal to, then the end time should be set to less than. If the entire interval is in a closed interval, it will cause the first and last two times to overlap, thus refreshing the duplicate.
Also, do not change the refresh period and time column after the initial incremental refresh is set.
You can change this by referring to the description in the documentation in the following post

Solved: Incremental refresh doubles my data - Microsoft Fabric Community
Configure incremental refresh and real-time data for Power BI semantic models - Power BI | Microsoft...
Solved: Incremental Refresh - Duplicate Rows for Refresh W... - Microsoft Fabric Community

vheqmsft_0-1718955560102.png

 

Best regards,
Albert He

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly

 

View solution in original post

3 REPLIES 3
Anonymous
Not applicable

Hi @shamnadkalathil ,
According to your description, your incremental refresh data was duplicated after the refresh was performed. This may be due to the duplication of the parameter range you set, e.g. if the start time is set to greater than or equal to, then the end time should be set to less than. If the entire interval is in a closed interval, it will cause the first and last two times to overlap, thus refreshing the duplicate.
Also, do not change the refresh period and time column after the initial incremental refresh is set.
You can change this by referring to the description in the documentation in the following post

Solved: Incremental refresh doubles my data - Microsoft Fabric Community
Configure incremental refresh and real-time data for Power BI semantic models - Power BI | Microsoft...
Solved: Incremental Refresh - Duplicate Rows for Refresh W... - Microsoft Fabric Community

vheqmsft_0-1718955560102.png

 

Best regards,
Albert He

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly

 

shamnadkalathil
Frequent Visitor

Hi @Idrissshatila , thank you for the reply.

I have unchecked the option "autodetect new relationships after data is loaded".

Is this maybe the issue?

 

Idrissshatila
Super User
Super User

Hello @shamnadkalathil .

 

I don't think it's related to incremental refresh, check if you're merging with another table through a field that has duplicates, this will duplicate your data.

 

check the number of rows before certain steps to get to know which step is causing the duplication.



Did I answer your question? Mark my post as a solution! Appreciate your Kudos
Follow me on LinkedIn linkedIn
Vote for my Community Mobile App Idea

Proud to be a Super User!




Helpful resources

Announcements
Join our Fabric User Panel

Join our Fabric User Panel

This is your chance to engage directly with the engineering team behind Fabric and Power BI. Share your experiences and shape the future.

June 2025 Power BI Update Carousel

Power BI Monthly Update - June 2025

Check out the June 2025 Power BI update to learn about new features.

June 2025 community update carousel

Fabric Community Update - June 2025

Find out what's new and trending in the Fabric community.