Forum Discussion
Data Refresh in a Power BI Dataflow
- 2 years ago
Fair enough. Just be aware that data flows are flat files too, so you are shuffling data from one delta table to another. If there is no cost to querying your delta tables multiple times I would cut out the extra step.
I would be first extracting the data into a data flow
What made you choose that? Is your data source slow?
Should the initial data flow be a full refresh and then an incremental refresh from the second run there after OR I can start the first refresh with an incremental refresh.
I am not aware of a way to bootstrap the partitions of a dataflow. You can do that with datasets semantic models though, and then refresh individual partitions independently-ish (assuming they have no joins to auto date time tables etc)
If you are on Fabric you need to beware of long running dataflows. When they complete they will hit your CU limit, and hit it hard, immediately blocking your capacity until the burndown has completed. Unfortunately the 5 hr refresh limit does not apply to dataflows.