Forum Discussion

haqv's avatar
haqv
New Member
1 year ago
Solved

Schedules/On-demand refresh failed

Hello Power Bi team,   I had a Pbi report with size of 800mb. Data is connected to PBI report via sharepoint folder gateway. My data is about 3Gb-5Gb for 3-year transactions. I publised my report t...
Need Help
  • tharunkumarRTK's avatar
    tharunkumarRTK
    1 year ago

    haqv 

    Incremental refresh with sharepoint or onedrive is not feasible though there are few workarounds, pelase follow the instructions in this video and see if there is anything wrong in the implementation 

    https://www.youtube.com/watch?v=6Uy59RsqgrM

     

    I would suggest you not to perform the full load during the initial refresh, rather perform the bootstraped refresh i.e. truncate the dataset and perform the first load. This will create empty partitions in the power bi service. Then refresh the partitions one after the other. Instructions are here

    https://learn.microsoft.com/en-us/power-bi/connect-data/incremental-refresh-xmla#prevent-timeouts-on-initial-full-refresh

     

    Considering you are using data gateway, and your sources are excel files, make sure your gateway server has sufficient resources to perform the data refresh.

     

    Need a Power BI Consultation? Hire me on Upwork

     

     

     

    Connect on LinkedIn

     

     

     








    Did I answer your question? Mark my post as a solution!
    If I helped you, click on the Thumbs Up to give Kudos.

    Proud to be a Super User!
ribisht17's avatar
ribisht17
Icon for Super User rankSuper User
1 year ago

Hi haqv 

 

It sounds like your Power BI scheduled refresh is struggling due to the large dataset size and SharePoint folder gateway connection. Since your incremental refresh works fine on Power BI Desktop but fails in Power BI Service, here are some possible solutions:

 

To improve your Power BI refresh performance, first check query folding to ensure queries are optimized for efficiency. Next, optimize your data model by reducing unnecessary columns, filtering data effectively, and avoiding complex transformations. Verify your gateway performance to ensure that the SharePoint folder connection is handling data smoothly. If needed, increase timeout settings in Power BI Service to allow longer refresh durations. Since you have a Premium Per User (PPU) license, make sure your report is published in a PPU workspace rather than "Other Workspace." Finally, monitor refresh logs in Power BI Service to identify errors or bottlenecks that may be impacting performance.

Additional Resources:

You can find more details on incremental refresh issues and PPU limitations in the Microsoft Fabric Community and Power BI Scheduled Refresh Guide.

 

Regards,

Ritesh

Community Champion

Please mark the answer if helpful so that it can help others

Dance-Sing with Data Projects - YouTube