Forum Discussion

sudhakarm's avatar
sudhakarm
Regular Visitor
4 years ago
Solved

Data Source Times out with Folder CSV files 125MB upload

PBI report with Folder data source consists of 8 CSV files with 125MB total size, computation taking 2+ hours in desktop and in services it simply data source timed out coming.

Computation consits of 8 CSV files Group By, Append Queries.

 

Please help on this.
Is it true that Power BI Pro Refresh time is limited for 2Hrs

  • Anonymous's avatar
    Anonymous
    4 years ago

    Hi sudhakarm ,

     

    Are you using the Personal On-Premise Data Gateway, or the Enterprise On-Premise Data Gateway?

    Have you got the latest version installed?

     

    I would suggest first testing the refresh manually, by using the Refresh Now option from the dataset. Wait for that to complete and see how long it takes.

     

    Only once it can refresh successfully manually would I then look into scheduling the refresh. 

     

    At the same time, if you are using import mode, the data loading time depends on the following:

    1. The size, row, column and table of the data model. If there is a complex DAX function to calculate the calculated column and table, it will be stored in the data model and increase a lot of time (you can optimize the model according to this link)
    2. It may also be related to hardware performance and network performance,network status between pc and datasource, and also the performance of pc which runs the power bi.

    So you may need to check your DAX measure or power query, see if there are areas that can be optimized.

     

    Hope this link can help you:

    Solved: Refresh Failing-Timeout - Microsoft Power BI Community

    Solved: data source timed out , refreshing process failed - Microsoft Power BI Community

    Data reduction techniques for Import modeling - Power BI | Microsoft Docs

     

    Best regards,

    Community Support Team Selina zhu

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly

2 Replies

  • On Shared capacity the limit is 2 hours. On Premium capacity the dataset refresh limit is 5 hours (300 minutes) - but only for some refresh types.

     

    Would you mind showing a sanitized version of your Power Query code?

  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi sudhakarm ,

     

    Are you using the Personal On-Premise Data Gateway, or the Enterprise On-Premise Data Gateway?

    Have you got the latest version installed?

     

    I would suggest first testing the refresh manually, by using the Refresh Now option from the dataset. Wait for that to complete and see how long it takes.

     

    Only once it can refresh successfully manually would I then look into scheduling the refresh. 

     

    At the same time, if you are using import mode, the data loading time depends on the following:

    1. The size, row, column and table of the data model. If there is a complex DAX function to calculate the calculated column and table, it will be stored in the data model and increase a lot of time (you can optimize the model according to this link)
    2. It may also be related to hardware performance and network performance,network status between pc and datasource, and also the performance of pc which runs the power bi.

    So you may need to check your DAX measure or power query, see if there are areas that can be optimized.

     

    Hope this link can help you:

    Solved: Refresh Failing-Timeout - Microsoft Power BI Community

    Solved: data source timed out , refreshing process failed - Microsoft Power BI Community

    Data reduction techniques for Import modeling - Power BI | Microsoft Docs

     

    Best regards,

    Community Support Team Selina zhu

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly