Forum Discussion
Table.Combine in parallel possible?
Hello colleagues
To work around a constraint pulling data from our source system, I am splitting up the data pull into 3 queries that all have their date filter criteria. I then append them all into a single table to be used in my model.
The 3 sub queries have 'enable load' disabled to avoid loading the data to my model twice.
Monitoring the query execution, it seems that table.combine executes the 3 sub queries one after another.
Does anyone know of a way to do this in parallel, so that it is faster?
Thank you
Bart
8 Replies
Where are you monitoring this, in Power BI Desktop or in the service?
I am monitoring this in the source system (SAP). FYI we are using an OData service based on SAP data to pull in the data.
In that SAP monitor, I can see only the first subquery executing, and once it finishes it starts the 2nd one in the Table.Combine list of tables, etc.
If I keep 'Enable Load' enabled on the subqueries, then I see 4 queries hitting SAP at the same time: the 3 subqueries and the first subquery in the Table.Combine list.
Interestingly, the remaining 2 subqueries in the Table.Combine list are no longer sent to SAP. Assume this is because by the time Table.Combine starts processing them, they are already somehow cached.
Query1 & Query2 & Query3 ...
If the queries are not too large you can also do it DAX UNION instead.
