Forum Discussion
Solved
Data Refresh in a Power BI Dataflow
My client has a 135 GB data set in a delta table that has been setup for the purpose of a PoC which needs to be displayed on to a Power BI a report. This is the data count i have for the PoC I am...
Fair enough. Just be aware that data flows are flat files too, so you are shuffling data from one delta table to another. If there is no cost to querying your delta tables multiple times I would cut out the extra step.
No the DataSource is fast enough. We are planning to have multiple Datasets depeneding on the granularity. So the idea was to implement a DataFlow and pull in all the data into this dataflow and then the dataSet can use the DataFlow as the source instead of hitting against the Azure Databricks Delta Tables.
Fair enough. Just be aware that data flows are flat files too, so you are shuffling data from one delta table to another. If there is no cost to querying your delta tables multiple times I would cut out the extra step.