I create a query in Power BI Desktop against a data source. Power BI Desktop insists on executing it multiple (usually three) times. This makes Desktop slow and for back-end data sources exerts additional load that can also incur additional costs. Note: I am not talking about the scenario where a query is referred to multiple times in M, rather just a simple query loaded into one table in the data model. I assume the engine is checking data types, etc - but the current approach is very slow/painful. Optimisation is needed!
20 Comments
- bdfoxNew MemberVery much needed for big data. Having a query that hits billions of records run multiple times can add hours in processing time. We currently have to write the data to a temp table so we can bring it into Power BI, but only one dashboard is using that particular dataset, so...
- Bob_HornungNew MemberWe have been fighting the same issue & agree it's a bigger problem with large datasets. We commonly see duplicate requests issued to the source (via on prem gateway) by an otherwise simple Power BI Online refresh.
- ml1787New MemberIf it does not get fixed, it may be the death of the product here. I will need to use something else.
- Chris_AmoreNew MemberHow do you monitor this type of activity? With the Prem-logs? We are struggling with refresh performance, timeouts and failure and I would like to see if this is part of our issue. This seems like a good way to make Microsoft customers pay for more capacity.
- pbiideas1New MemberHi Microsoft team ! What about this really important issue ? It is not acceptable from customers not to have any answer or solution for this old issue, which is really problematic for us as several users run queries from PowerBi Desktop to our datasources (like Hive) and this become now a real performance issue for our platform. We really need a solution from your team. Quickly.
- martin_esani2New MemberAbsolutely ridiculous that this happens. I try to refresh a dashboard, the query for 2 years takes 30 minutes. Three executions of the query (2 of which are unnecessary) take 1 hour 30. Not sure why this is.
- alex_hollowayNew MemberNot sure if I have the exact same problem as the OP but working on the data model in complex cases is very painful and it needs to be easier to jump between transformations to debug issues without issuing a fresh recall of data
- mikecroNew MemberWhat type of source are you having issues with? I was seeing the behaviour you describe with Excel files on SharePoint and found that defining them as "From Web" rather than "From Excel" means that they are cached and not reread
- fbcideas_migusrNew MemberNo information from Power BI team? At least please let us know why it happens
- Bob_HornungNew MemberThis is becoming a significant concern for us as well. Power BI seems to be putting an unnecessary load on our source systems.
Recent ideas
About "Download SQL database project" and fix the downloaded project
1. The sqlproj must be fixed, it is downloaded without the xml markup line <?xml version="1.0" encoding="utf-8"> 2. The sdk must be updated: Actual: <Sdk Name="Microsoft.Build.Sql" Version="0.1...Jarrinf7 hours agoFrequent VisitorNew48Views3likes2CommentsEventstream MQTT broker source: V3.1.1 support
The Eventstream MQTT broker source supports connections with public MQTT brokers that offer MQTT V5 support. Please offer support for V3.1.1 too, because this is still a valid and widely used ver...svelde8 hours agoSuper UserCompleted1.4KViews6likes4CommentsGet data from Apache Kafka topics via private networking
Current prerequisites limit to public Kafka instances which is not feasible for most enterprise customers. When will this limitation be lifted so that it can be used in private network setups, for ...Jugi8 hours agoMicrosoft EmployeePlanned3.5KViews2likes3CommentsSet default x axis scrolling position
Enable selection of the default scroll position for the x-axis on a chart. For example, on a line chart with dates as the x-axis, when not all of the data can display in the view at once, the scroll...Lisa_Krieg16 hours agoNew MemberNeeds Votes7.8KViews1154likes104Comments