Forum Discussion
Converting text to date breaks query folding in Sap BW source
Super UserThat video only shows that the customer didn't understand how Incremental Refresh works in the service. In their scenario the filtering needs to happen in the native query. Then it will work, despite not folding.
You need to keep in mind that the ultimate goal of incremental refresh is to flush and fill a partition. Nothing more, nothing less.
Please show a sanitized version of your M code.
I think you are answering a different goal - my goal is to use incremental refresh and obtain it's performance gains in refresh time not just do it for it's technical description of flushing and filling a partition. I also want the benefit of quicker refresh times and that is what I would like to emphasise.
It sounds like you sare saying if I implement a non query folded incremental refresh it will not provide the refresh performance time gain that I am after, therefore I will not continue here.
As if now then my belief is that with a text date it is not possible to gain any performance improvement by using incremental refresh. I will end the investigation here unless anyone has an example where they have done it and can post about it, thanks.
- lbendlin
my goal is to use incremental refresh and obtain it's performance gains in refresh timeYou can specify partitions down to day level. That should keep your refresh time down.
The real issue with incremental refresh is that it is incremental. What most business scenarios require is differential refresh or CDC. You need to do extra work to accomplish that with the given Microsoft features.