Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

The Power BI Data Visualization World Championships is back! Get ahead of the game and start preparing now! Learn more

Reply
santhiya
Helper I
Helper I

Incremental Refresh creating Duplicate Records

Hi community!!!
I am using the following method to view reports in Power BI 

Dataflow -> Dataset -> Report 

I used import mode and I have configured Incremental Refresh for My dataflow and dataset. In the configuration I have selected the following 

store last 10 years 

Refresh last 2 months . I am filtering based on updated_at column , if the updated_at column is in the last 2 months there is no problem but when it is in the last 10 years two records will be loaded into my model . I can remove this duplicates with Sort based on updated_at and remove duplicate but what it does is break my query folding which indirectly breaks the logic of Incremental refresh as well. Instead of Loading only the last 2 months entire period will be loaded and filter will be applied . But how to avoid this , whether I need to avoid the duplicates by configuring the Incremental refresh in some other way or removing duplicates without breaking query folding or some other suggestions please?


 

Thanks

 

1 REPLY 1
AntrikshSharma
Super User
Super User

@santhiya Generally duplicates are introduced in Incremental Refresh when in the both Start and End criteria you specify the "=" so you need to remove it from either one of them.

Helpful resources

Announcements
Power BI DataViz World Championships

Power BI Dataviz World Championships

The Power BI Data Visualization World Championships is back! Get ahead of the game and start preparing now!

December 2025 Power BI Update Carousel

Power BI Monthly Update - December 2025

Check out the December 2025 Power BI Holiday Recap!

FabCon Atlanta 2026 carousel

FabCon Atlanta 2026

Join us at FabCon Atlanta, March 16-20, for the ultimate Fabric, Power BI, AI and SQL community-led event. Save $200 with code FABCOMM.