Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

July 7 - July 17 | Round 2 of the Power BI Dataviz World Championships. Don't miss your chance! Learn more

Reply
santhiya
Helper I
Helper I

Incremental Refresh creating Duplicate Records

Hi community!!!
I am using the following method to view reports in Power BI 

Dataflow -> Dataset -> Report 

I used import mode and I have configured Incremental Refresh for My dataflow and dataset. In the configuration I have selected the following 

store last 10 years 

Refresh last 2 months . I am filtering based on updated_at column , if the updated_at column is in the last 2 months there is no problem but when it is in the last 10 years two records will be loaded into my model . I can remove this duplicates with Sort based on updated_at and remove duplicate but what it does is break my query folding which indirectly breaks the logic of Incremental refresh as well. Instead of Loading only the last 2 months entire period will be loaded and filter will be applied . But how to avoid this , whether I need to avoid the duplicates by configuring the Incremental refresh in some other way or removing duplicates without breaking query folding or some other suggestions please?


 

Thanks

 

1 REPLY 1
AntrikshSharma
Community Champion
Community Champion

@santhiya Generally duplicates are introduced in Incremental Refresh when in the both Start and End criteria you specify the "=" so you need to remove it from either one of them.

Helpful resources

Announcements
FabCon and SQLCon Barcelona 2026

FabCon & SQLCon – Barcelona 2026

Join us in Barcelona for FabCon and SQLCon, the Fabric, Power BI, SQL, and AI community event. Save €200 with code FABCMTY200.

60 days of Data Days Carousel

Data Days 2026

Join Data Days 2026: 60 days of free live/on-demand sessions, challenges, study groups, and certification opportunities.

Power BI DataViz World Championships carousel

Power BI DataViz World Championships - June 2026

A new Power BI DataViz World Championship is coming this June! Don't miss out on submitting your entry.

Top Kudoed Authors