Is it possible to switch between incremental and full refresh of a dataflow?

[davidismaeloch]

Hi everyone!
This is my case:
I have premium capacity and I turned on the Incremental refresh on multiple tables of my dataflows, but now we are facing a problem; some records/rows from previous years are being modified from time to time, so the incremental refresh is now blocking us to get those old rows updated 😞 so basically it feels that the incremental refresh is futile for our project. 

Is there a way to authomatically set a rule to switch between incremental and full refresh from time to time?

Thank you, Have a nice day!!
David.

[DeeceC]

Ideally better to force  full Df Refresh pity there is no API to switch between the 2

[GilbertQ]

Hi @davidismaeloch 

There is another option in incremental reresh where you can enable it to detect data changes, which can be on a column which will update the date when data is being updated. This will then allow you to do is to be able to use incremental refresh as well as update for those columns where the data has changed Here are more details on this: Incremental refresh for semantic models and real-time data in Power BI - Power BI | Microsoft Learn

[davidismaeloch]

Hi! @GilbertQ 
The 'detect data changes' didn't worked for us because it doesn't detect changes at row level, e.g. if someones modify the content of one row that is in the 'historical' partition of the incremental refresh, then that modification won't be shown on the dashboard. That is the issue we are facing, we want to have incremental refresh for better perfomance but some historical records could be modified from time to time, that's why I was thinking if there is a way to automatically switch between full and incremental refresh?.

[GilbertQ]

Hi @davidismaeloch 

As far as I am away, we detect data changes does happen at the low level as long as you change the modified date on the row level. I have seen this working in the past.