Power BI Scheduled Refresh for Big Data

[Anonymous]

Hello, Seeking your advice or recommendations for scheduled refresh in the PBI Service for big data.

for context:

Our KPIs Dataset is connected to different Datasources (SharePoint, CRM, AWS/ERP), and we use VDI (Virtual Desktop) for the gateway since most of its critical data is being dumped (it is also scheduled) into a local folder (csv file).

what our workaround is to manually refresh the KPIs Dataset and publish it in to the workspace everyday and it takes around 1hr to 1hr and 30mins before to finish the manual refresh.

the reason why, we never set a scheduled refresh in PBI Service it will always fail (we're suspecting that this is because of its bid data?)

Question/s:
- Can we use Power Automate for this? to reduce the waiting time for this to be refreshed?

- or we can still configure it in the service?

- if the two mentioned above cannot be done, can you recommend other tools or ways?

Thank you!

[v-yifanw-msft · Accepted solution]

Hi @Anonymous ,

Depending on the issue you are experiencing, you can troubleshoot the cause of the refresh failure according to the following step-by-step plan:

1. Check the refresh history to find detailed error messages.
2. Check the configuration of the gateway and if the credentials are correct.
3. Check the network connection.

Regarding the possibility of using Power Automate to reduce the refresh time. The answer is yes, you can do this by setting up a flow in Power BI that uses the "Refresh Dataset" action. The following link is about how to use Power Automate to automate the refresh:

How to Refresh Power BI Dataset Using Power Automate (process.st)

Alternatively, you can try to optimize the performance of Power Bi to improve the efficiency of the refresh. You can refer to the following link for optimization:

Optimization guide for Power BI - Power BI | Microsoft Learn

^{Best Regards,}

^{Ada Wang}

^{If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.}