Forum Discussion
Dataset incremental refresh parametrization
Thank you lbendlin for your response!
Do we need to setup RangeStart and RangeEnd parameters for each table in a semantic model even if we have defined incremental policy on dataflow like above?
For example for the lineage from the attached image there is dataflow that has setup incremental policy for each table in semantic model.
So if we have setup dataflow incremental policy with defined "Store rows from the past", "Refresh rows from the past" parameters and selected "Detect data change" then do we need to have also setup RangeStart and RangeEnd parameters for each table in semantic model refresh in the downstream?
Thanks!
It is totally up to you where you want to set up incremental refresh. You can have it in datasets semantic models, dataflows, both, or none. My personal opinion is that it only makes sense in datasets semantic models. That is just an opinion based on the desire to arrive at the simplest possible solution (Occam's razor).