Forum Discussion

cassidy's avatar
cassidy
Power Participant
6 years ago

2 Datasets Refreshing at the same time

There are certain hours throughout the day where I have 1 very large Dataset refreshing at the same time as 1 very small Dataset, and they seem to impact eachother.

 

For example:

Large Dataset refresh time is typically 1 hour, every 3 hours.

Small Dataset refresh time is typically 3 minutes, every 30 minutes.

 

When the two overlap, the Small Dataset can run for up to 30 minutes.

 

Is it expected to see that impact?  Is there a way to give priority to the Smaller Dataset?

Need Help

4 Replies

  • v-yingjl's avatar
    v-yingjl
    Community Support
    6 years ago

    Hi cassidy ,

    If these two datasets configured under the same gateway, it is a normal phenomenon. 

    When different datasets are refreshed in parallel under the same gateway, the gateway resources will be occupied at the same time. The refreshing time for a small dataset is naturally longer than the time for a single refresh of this dataset.


    Currently, there is no option to select the refresh priority for the data set. We recommend that you avoid the same time period when configuring the scheduled refresh for each dataset to reduce resource occupation, and if your dataset has data sources from the cloud, you can refresh it directly through the cloud without configuring a gateway for it. In addition, you can also refer this document  to adding a gateway cluster.

     

    Best Regards,
    Yingjie Li

    If this post helps then please consider Accept it as the solution to help the other members find it more quickly.

    • cassidy's avatar
      cassidy
      Power Participant
      6 years ago

      Thanks for the response v-yingjl .  Neither Dataset uses a gateway, both pull from predominantly from Dataflows or an Azure Database.  Does that change anything about your recommendations?

      • v-yingjl's avatar
        v-yingjl
        Community Support
        6 years ago

        Hi cassidy ,

        It is a better suggestion to avoid refreshing different datasets in the same time period in power bi service currently regardless of whether you use a gateway or not.

        In addition, here is an idea about refresh priority in power bi service, you can vote for it to help us improve power bi and making this feature coming sooner.

         

        Best Regards,
        Yingjie Li

        If this post helps then please consider Accept it as the solution to help the other members find it more quickly.

  • v-yingjl's avatar
    v-yingjl
    Community Support
    6 years ago

    Hi cassidy ,

    If you've fixed the issue on your own please kindly share your solution. If the above posts help, please kindly mark it as a solution to help others find it more quickly. Thanks!


    Best Regards,
    Yingjie Li