Forum Discussion

msft-cap's avatar
msft-cap
Icon for Helper II rankHelper II
1 year ago

Process full refresh time out in Premium PBI model

Hi, 

We have a PBI model in premium, it usually refreshes in 2 hours. At times, it is timing out. 

 

The tables are refreshed as 'process full' approach. When monitored the SQL query activity, (for eg: 1 big table takes approx 20 minutes) to finish running query on SQL pool. However the process full will not complete for another 30 minutes. That means, recalc on that particular table is taking time or timing out. 

 

Is that a proper assumption on why refresh is timing out sometimes? how can I validate what is causing the timeout issues?

8 Replies

  • pborah's avatar
    pborah
    Icon for Solution Sage rankSolution Sage

    Hi msft-cap part of it depends on your Premium instance, as in - what tier are you subscribed to. That will determine what system capacity is available to you for a big refresh. The other thing to consider is if your pbix has calculated columns (and how many of them) that are derived from columns from SQL. Additionally, it depends on if the DAX code for those calculated columns is concise or overly lengthy or complex. That takes additional system resources. Finally, is there a specific reason you are reloading the entire dataset each refresh instead of doing incremental refresh? I can certainly understand specific scenarions where such a thing is necessary. We have a few reports where sometimes the original data for an old entry gets altered in light of new information so we do a full load once a month for those reports. 

    • msft-cap's avatar
      msft-cap
      Icon for Helper II rankHelper II

      Hi pborah - I am currently trying to explain the user why there are refresh time-outs rather than solving the issue. That is what they are looking for. Anywhere I can check for traffic on the server or that dataset that is causing timeouts? possible proofs to check what is exactly causing time-out during refresh.

      • pborah's avatar
        pborah
        Icon for Solution Sage rankSolution Sage

        If you are a Power BI admin or an O365 tenant admin, you might be able to obtain those logs and take a deep dive. Otherwise if you are a workspace admin for the specific workspace where that model is located in, you can try using powershell to run the refresh and have a verbose log output.

  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi msft-cap ,

     

    As a workspace administrator, you can view timeout details through the refresh history of the dataset. Dataset Refresh History Enhancements | Microsoft Power BI Blog | Microsoft Power BI

     

    The general refresh timeout problem is caused by large semantic models. Scheduled refreshes for imported semantic models time out after two hours. This time-out is increased to five hours for semantic models in Premium workspaces.

     

    If you encounter this limit, consider reducing the size or complexity of your semantic model, or consider refactoring the large semantic model into multiple smaller semantic models.

     

    Some other ways to work around refresh timeout are:

    1. Configure incremental refreshes for the tables in the model that need to be refreshed.Data refresh in Power BI - Power BI | Microsoft Learn

    2. XMLA:Semantic models on a Premium capacity with the XMLA endpoint enabled for read-write support unlimited refresh operations when configured programmatically with TMSL or PowerShell.Semantic model connectivity and management with the XMLA endpoint in Power BI - Power BI | Microsoft Learn

     

     

     

     

    Best regards,

    Mengmeng Li