Incremental Refresh Issue

[nareshr89]

I have set up incremental refresh on my dataset and have published the file successfully. The usual time to refresh dataset is 20 min, but when i refreshed in workspace it took 4 long house to fail. Then when i restarted the refresh again it failed with a message.

Data source error - The XML for Analysis request timed out before it was completed. Timeout value: 1911 sec.
Cluster URI- WABI-NORTH-EUROPE-C-PRIMARY-redirect.analysis.windows.net
Activity ID- 972bf294-2f47-4766-b7c9-5bc549c52e04
Request ID - f0ba83b2-3461-4cfb-929f-21f3fd40fc95
Time- 2022-03-20 16:03:31

Please suggest how to overcome this issue and set up the incremental refresh successfully. Also, if we make changes to dataset can we publish to overide the exisiting datset and still the incremental refresh to continue. @

[Anonymous]

Hi @nareshr89 ，

Based on this error message, it appears that the refresh request has timed out. Power BI Pro datasets have a refresh time limit of two hours and do not support getting real-time data with DirectQuery. For datasets in a Premium capacity, the time limit is five hours. Refresh operations are process and memory intensive. A full refresh operation can use as much as double the amount of memory required by the dataset alone because the service maintains a snapshot of the dataset in memory until the refresh operation is complete. Refresh operations can also be process intensive, consuming a significant amount of available CPU resources. You can check the following official documentation for details.

Time limits
What data source is your report connected to? Incremental refresh is designed for data sources that support query folding. If you are using a data source that does not support query folding, this may cause incremental refresh to slow down and the process may use up resources in the Power BI service or the local data gateway. You can refer to the following link to determine if the connected data source supports query folding.

Power Query query folding

Case of the Broken Power BI Incremental Refresh

And is the size of data model referenced by your report relatively large? If so, please consider to optimize your data model and republish it to Service.

Power BI Performance Tips and Techniques

Data Import Best Practices in Power BI

For the dataset in premium capacity, you can bootstrap an initial refresh operation by the open-source Tabular Editor 2 tool. Bootstrapping the initial refresh operation allows the service to create partition objects for the incremental refresh table, but not load and process historical data into any of the partitions...

Prevent timeouts on initial full refresh

Best Regards