Forum Discussion
Incremental Refresh - Archived data being removed after publishing and first refresh in the service
Hello Everyone,
I am implementing Incremental Refresh on my Dashboards where I have archived the Data from last 3 years i.e. from 1/1/2020 to 2/3/2023 and Incrementally refresh data starting for 5 days i.e. 2/4/2023 to 2/8/2023 .
When I published this file and kicked off the first refresh it reduced the row count from 268M to 265M (Screenshot below) after its first refresh.I see for other tables the row count increased after the first refresh in power bi service but for some it decreased similar to the one I shared above .
Parameters:
RangeStart = 1/1/2020 ,RangeEnd = 2/5/2023 IR_Interval = -2
can anyone help me understand what can be the possible reason for this?
Per my understanding,If I have archived historical data in my PBI file that data should remain same even after publishing it in the service and it should only bring in the new data after its refresh.
Thanks much in Advance
2 Replies
ppm1Solution Sage
Are you publishing your report with a small data range between RangeStart and RangeEnd? Those parameters are automatically changed/managed in the service once incremental refresh is enabled. Make sure that you don't have = on both filters in your query (>= RangeStart and < RangeEnd), to avoid duplicate rows between partitions.
Do you know the correct expected # of rows? Did the former dataset have = in both filters, so appeared artificially high?
Pat
No I am publishing with 3 years of data.I dont have both the filters (>= RangeStart and < RangeEnd) .they are >= and < . Expected# of rows should be 268M which got reduced to 265M after publishing and refreshing.Per my understanding ,# of rows should have been increased after refreshing it in service.