Forum Discussion
Dataflow never finishes loading
I'm working on a dataflow to pull AD data. The dataflow is running from an on-prem gateway, and should be a relatively quick query (5-10 minutes). Some times it runs and finishes in that timeframe, ...
Hi cpeavyhouse ,
You may need to improve the dataflow performance:
- Use incremental refresh for dataflow, see more detail:https://docs.microsoft.com/en-us/power-bi/service-dataflows-incremental-refresh.
- If you have a Premium license, you will have access to more or fewer functionalities within Dataflow, see more: https://blogs.solidq.com/en/businessanalytics/power-bi-dataflows-how-does-the-new-tool-work/. (Please understand that this link is provided “AS IS” with no warranties or guarantees of content changes, and confers no rights.)
Best Regards,
Amy
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly
My eventual workaround involved breaking my queries down into several smaller queries that run in parallel. After all of the queries have finished, I join the results in a second dataflow to get the results I was expecting. My best guess is that, at some level, my query did not work well with the optimization engine and the dataflow was hitting AD several times for every entity. I'm still not sure why my original error was occuring, but with my workaround, I haven't run into again.