Dataset incremental refresh parametrization

[momir-beljic]

Hi, is there a way to parametrize fields for incremental refresh such as data from the past for full load and incremental refresh frequency like from the image. 
We have a lot of datasets and it is inconvinient to manually go over each and set those and mainitain.

So is there some API or way to have more control in setting this up?

Thank you!

[momir-beljic]

Thank you @lbendlin for your response!

Do we need to setup RangeStart and RangeEnd parameters for each table in a semantic model even if we have defined incremental policy on dataflow like above?
For example for the  lineage from the attached image there is dataflow that has setup incremental policy for each table in semantic model.

So if we have setup dataflow incremental policy with defined "Store rows from the past", "Refresh rows from the past" parameters and selected "Detect data change" then do we need to have also setup RangeStart and RangeEnd parameters for each table in semantic model refresh in the downstream?

Thanks!

[lbendlin]

It is totally up to you where you want to set up incremental refresh. You can have it in datasets semantic models, dataflows, both, or none.  My personal opinion is that it only makes sense in datasets semantic models. That is just an opinion based on the desire to arrive at the simplest possible solution (Occam's razor).

[lbendlin]

The dialog you are showing is for dataflows, not datasets semantic models. You have no control over the parameters in a dataflow, they will be added for you.  In a dataset semantic model scenario you have to create RangeStart and RangeEnd yourself, and you can decide how to integrate them into your query (and when).