What is the proper use case for Dataflows

My organization is fairly new to Power BI, and I'm not 100% sure we are trying to use Dataflows how they're intended. For instance, we have a star schema and want to consume that data through Power ...

Anonymous

Not applicable

6 years ago

Greg_Deckler - Thanks for the advice. Are you saying there is an incremental refresh option for the dataset? I know of the incremental refresh option for dataflows, but the dataflows refresh fine. We only run into memory issues when we attempt to refresh the dataset built from the dataflows.

We enabled the enhanced compute engine and tried directquery against the dataflows themselves. We ended up using about 1/3 of the tables with directquery and 2/3 dataflows and still exceeded our memory. We may just switch it over to directquery against DB2 and see how that works.

v-lionel-msft

Community Support

6 years ago

Hi Anonymous ,

1. For the role of Dataflow, you can study this document.

“As data volume continues to grow, so does the challenge of wrangling that data into well-formed, actionable information. We want data that’s ready for analytics, to populate visuals, reports, and dashboards, so we can quickly turn our volumes of data into actionable insights. With self-service data prep for big data in Power BI, you can go from data to Power BI insights with just a few clicks...”

Self-service data prep in Power BI

2. “We only run into memory issues when we attempt to refresh the dataset built from the dataflows.”

Maybe your local computer’s configuration can not load such a large dataset. You can refer to these links and try to reduce the query cache.

Are Your Power BI Performance Issues Due To High Memory Consumption?

Ten Techniques for Optimising Memory Usage in Microsoft Power BI

Performance Tip for Power BI; Enable Load Sucks Memory Up

Incremental refresh in Power BI

Best regards,
Lionel Chen

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.