Forum Discussion
Incremental Refresh Error
Hi everyone, Incremental refresh stops working when I changed the data type of another column.
These are my applied steps. I made no changes to the datetime column used for filtering. I have also tried filtering before and after changing the data type but new data is not coming when I refresh the dataset. Also refresh always complete successfully but new data is not coming. If I remove the Changed Type step, it is working fine and new data comes when I refreshed. But I need to change the data type of the column. What could be the problem and solution?
12 Replies
Hi rdini8 - Incremental refresh relies heavily on query folding. If the data type change step breaks query folding, incremental refresh might not work correctly.To verify query folding, right-click on each step in the Power Query Editor and check if "View Native Query" is available. If it is not available after the data type change step, query folding is broken.
Reference link:
https://radacad.com/all-you-need-to-know-about-the-incremental-refresh-in-power-bi-load-changes-only
How to Implement Incremental Refresh in Power BI | phData
Hope it helps
Did I answer your question? Mark my post as a solution! This will help others on the forum!
Appreciate your Kudos!!I have checked the native query is still available at the end of the applied steps. What else can be the problem?
just to add to rajendraongole1 's answer. some data type change may not break query folding. here is an old article that highlights some of the possible changes: Changing data types that do not break query-folding in Power Query / Power BI (brunner.bi)
I changed only one column from whole number to text. Also I checked at the end of the applied steps, the native query is still available.
Hi，
Thanks for the solutions davidding and rajendraongole1 provided, and i want to offer some more information for user to refet to.
hello rdini8 ,
the reason for the problem:
If you change the data type after you have set up incremental refresh, the current data type may be different from the data type in the historical interval during incremental refresh.and the data may not be detected for this reason, so the data will not be returned.
Solution:
You may consider reconfiguring incremental refresh after changing the data typeBest Regards!
Yolo Zhu
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Hi, I have tried filtering both before and after datatype changes. It's not working for either.
Hi rdini8
Thanks for your quick reply, you may not understand what I mean, are you already setting incremental refresh, and then back to Power Query to add the step of modifying the data type, because you have set up incremental refresh, so the original type is retained in the historical partition, when you modify the data type, after the partition is refreshed, you can't find the new data type in the original data, so you need to set the incremental refresh again.
Best Regards!
Yolo Zhu
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
