Forum Discussion
Incremental Refresh on a dataset with Dataflows as a data source
Hi Anonymous ,
Yes, please check whether the underlying data source used in the dataflow support query folding or not. For the data sources that do not support query folding, you can set incremental refresh, but it may retrieve the entire data anyways.
Best Regards
Rena
Anonymous How is the underlying data source relevant? I'm connecting to Dataflows. The dataset doesn't care where I get the data from before that point, does it?
The question is, when I'm refreshing my dataset, do the queries it sends to dataflows get folded and is Incremental Refresh possible in this case? Or will it always load in the entire dataflow?
We have the very same question (dataset incremental refresh using dataflows as source, regardless of how the dataflow itself gets its data).
Has this been answered?
The simple answer is NO.
Many have tried workarounds, but nothing official from @microsoft.
pat_mecee Have you tested this? I ran a test and it seemed to work, but I did not proceed (my responsibility is just to create the dataflow sources and I do not use PBI Desktop or datasets much).
It would be nice to have official communication here.
"Dataflow incremental refresh and dataset incremental refresh are designed to work in tandem. It's acceptable and supported to have an incrementally refreshing entity in a dataflow, fully loaded into a dataset, or a fully loaded entity in a dataflow incrementally loaded to a dataset.
Both approaches work according to your specified definitions in the refresh settings."
