I create a query in Power BI Desktop against a data source. Power BI Desktop insists on executing it multiple (usually three) times. This makes Desktop slow and for back-end data sources exerts additional load that can also incur additional costs. Note: I am not talking about the scenario where a query is referred to multiple times in M, rather just a simple query loaded into one table in the data model. I assume the engine is checking data types, etc - but the current approach is very slow/painful. Optimisation is needed!
20 Comments
- bdfoxNew MemberVery much needed for big data. Having a query that hits billions of records run multiple times can add hours in processing time. We currently have to write the data to a temp table so we can bring it into Power BI, but only one dashboard is using that particular dataset, so...
- Bob_HornungNew MemberWe have been fighting the same issue & agree it's a bigger problem with large datasets. We commonly see duplicate requests issued to the source (via on prem gateway) by an otherwise simple Power BI Online refresh.
- ml1787New MemberIf it does not get fixed, it may be the death of the product here. I will need to use something else.
- Chris_AmoreNew MemberHow do you monitor this type of activity? With the Prem-logs? We are struggling with refresh performance, timeouts and failure and I would like to see if this is part of our issue. This seems like a good way to make Microsoft customers pay for more capacity.
- pbiideas1New MemberHi Microsoft team ! What about this really important issue ? It is not acceptable from customers not to have any answer or solution for this old issue, which is really problematic for us as several users run queries from PowerBi Desktop to our datasources (like Hive) and this become now a real performance issue for our platform. We really need a solution from your team. Quickly.
- martin_esani2New MemberAbsolutely ridiculous that this happens. I try to refresh a dashboard, the query for 2 years takes 30 minutes. Three executions of the query (2 of which are unnecessary) take 1 hour 30. Not sure why this is.
- alex_hollowayNew MemberNot sure if I have the exact same problem as the OP but working on the data model in complex cases is very painful and it needs to be easier to jump between transformations to debug issues without issuing a fresh recall of data
- mikecroNew MemberWhat type of source are you having issues with? I was seeing the behaviour you describe with Excel files on SharePoint and found that defining them as "From Web" rather than "From Excel" means that they are cached and not reread
- fbcideas_migusrNew MemberNo information from Power BI team? At least please let us know why it happens
- Bob_HornungNew MemberThis is becoming a significant concern for us as well. Power BI seems to be putting an unnecessary load on our source systems.
Recent ideas
Data Pipelines - Run only selected activities
For debugging and testing pipeline activities during development, allow us to select one or multiple activities and run only the selected pipeline activities. For example, I'm working on editing ...frithjof_v23 hours agoCommunity ChampionNew618Views11likes2CommentsSemantic model connection bindings should be in source control (Git)
Semantic model data source connection bindings should be source controlled. A semantic model can contain multiple data source references, each of which can be mapped to a separate Fabric data connec...frithjof_v1 day agoCommunity ChampionNew21Views1like0CommentsBulk changing column names in Visualizations Pane
We often use raw/api column names or measures with a set nomenclature to be consistent and to keep track of them but we do not want to display these names in the visuals. Currently we have to change ...vishal1401971 day agoFrequent VisitorNew6Views0likes0Comments