Forum Discussion
Incremental refresh is loading data only within the parameters date range after refresh in service
Hi,
I have 5 sales tables, 1 article table, date table and 1 store table. I have used these tables to further create a compiled sales table. In Power Query, I have implemented the RangeStart & RangeEnd Parameter filters on the step where we can see Query folding on 4 of the sales tables. After that I have merged the article table with each of these tables to extract some required article attributes. Out of the 5 sales tables, there is 1 sales table which has been developed by merging 3 other small tables. And I have implemeted the RangeStart & RangeEnd Parameter filters on the step where we can see Query folding on these 3 tables also. I have loaded all these table and applied the incremental refresh step on each one of them, except the Article table, date table, 1 store table, the compiled sales table & the sales table which has been developed by merging 3 other small tables ( instead have applied incremental refresh on these 3). After publishing the report on Premium, when I run refresh, I neither get any error, nor the data beyond the Paramter's range is reflecting. the RangeStart date is 1st May 2023 & RangeEnd date is 31st May 2023. And in incremental refresh I have given archive data starting 2 years. In Service I can see only data for May 2023.
Someone please help me on this.
Thank you.
Best regards,
Neha
5 Replies
Hi Anonymous ,
Please have a check.
One thing to check is whether the data you are expecting to see beyond the date range actually exists in the data source. If the data does not exist, then it will not be loaded even if you have set up incremental refresh.
Another thing to check is whether the incremental refresh settings are correctly applied to all the tables. It's possible that there may be a mistake in the settings for the tables that are not showing the expected data. You may want to double-check the settings for those tables to make sure they are set up correctly.
How to Get Your Question Answered Quickly
If it does not help, please provide more details.
Best Regards
Community Support Team _ RongtieIf this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Hi Rongtie,
The data exisits in the data set. I can say this confidentaly becasue the other report on the same dataset without the incremental refresh is picking up the entire range's data. Regrading double checking the tables' setting, I will do it once more. However, please help me to understand can the merge tables step cause any hindrance in incremental refresh?
Or is it possbile that the table where the data is loading finally (and which is used for the visuals) is created in Power Query by appending all the other sales tables, which is why incremental refresh is failing?
Thank you.
Best Regards,
Neha
Hi Anonymous ,
It is strange that no error message appears.
Check whether the RangeStart and RangeEnd parameters are being passed correctly to the queries. You can check this by looking at the query execution plan and verifying that the parameters are being used to filter the data.
And please make sure you have successfully set up incremental refresh.
Please pay attention to the limitations.
Incremental refresh for datasets and real-time data in Power BI - Power BI | Microsoft Learn
Best Regards
Community Support Team _ RongtieIf this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Hi,
I am going crazy with this incremental refresh. It's just not happening. The data is refreshing, without any error but not giving the entire date range's data. The steps I have followed are
1. In all the fact tables, applied the Date Paramater filter on the step where Query Folding is happening. Post that there are other steps, like changing column names, merging with other tables, etc.2. All the fact tables are appeneded in one table to create a separate Compiled sales table.
3. There are other dimension tables on which I have not added the incremental refresh.
4. All these tables are loaded.
5. On each individual sales table, incremental refresh is then applied.
I want to load data from last year and all the databases have this data. RangeStart Date is 1st Jan23 and RangeEnd Date is 31st May 23. After publishing and after the 1st manual refresh, data for 1st Jan - 31stMay is only reflecting.
Please help.Thanks & Regards,
Neha