Forum Discussion

mmace1's avatar
mmace1
Icon for Impactful Individual rankImpactful Individual
5 years ago

Do Dataflow entities refresh in Series or in Parallel?

Hi, 

 

If you have > 1 entity within a Dataflow, when the dataflow refreshes:

  • do the entities refresh at the same time (i.e. in parallel)
  • or one at a time (i.e. in a series?). 

And can the behavior, whatever it is, be modified? 

I see an older question ended with "Not known, check with the Azure Data Lake folks" as an answer but that was almost 2 yeras ago, so seems worth checking again. 


3 Replies

    • Anonymous's avatar
      Anonymous
      Not applicable

      The dataflow refresh history allows you to see the execution times by table including start and end time. You can clearly see that tables are executed sequentially. I have not found any option which allows you to execute in parallel as you can with a dataset. Hopefully, this is something the Microsoft Power BI team will address. They are being "tight-lipped" which means they probably know about it but do not now how to address it.

       

      Requested onDataflow nameDataflow refresh statusTable nameRefresh statusStart timeEnd timeDuration
      10/13/2023 3:42Common DataflowCompletedCalendarCompleted10/13/2023 3:42:0210/13/2023 3:42:3300:31.1
      10/13/2023 3:42Common DataflowCompletedCustomerCompleted10/13/2023 3:42:3310/13/2023 3:43:0400:30.5
      10/13/2023 3:43Common DataflowCompletedItemCompleted10/13/2023 3:43:0410/13/2023 3:43:3500:30.6

       

      I have added this as a topic of consideration. You can vote for this enhancement here.