Forum Discussion
Sharepoint & PowerBI reporting refresh issues
- 3 years ago
Hi, RalZRR
According to your description, your data flow is connected to the Sharepoint data source, but the data volume refresh lasts for a long time, and finally reports an error: Sharepoint connection timed out - too many requests. For the problem of data stream refresh timeout, the suggestions we can give can be divided into two aspects:
- You can try to optimize the complexity of the ETL process of the data flow and reduce the two-table Merge and Append operations in the data transformation step in the data flow.
- You can try to refresh the amount of data to avoid the timeout caused by too much data that needs to be refreshed. You can try to use the "Filter" function in Power Query online to try to filter the date column to reduce the data to half of the original Or a quarter, try to see if the refresh will take effect.
Another point we would like to confirm with you is whether you can try to consider the possibility of using datasets instead of data streams, because datasets can be refreshed through XMLA endpoints by connecting to SSMS, and this refresh has no time limit, You can do this by creating a blank query in the desktop to copy-paste the M code from the "Advanced editor" into it and give the same credentials For specific documents, please refer to this: Dataset connectivity and management with the XMLA endpoint in Power BI - Power BI | Microsoft Docs
At the same time, regarding the difference between the export data from the SharePoint API and the "Export to Excel" function of the SP list itself that you mentioned later, I'm sorry, you can try to open a post in the SharePoint forum to inquire about SharePoint experts, they will know more and give professional answers.
Best Regards,
Aniya Zhang
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly
Indeed running the report with a dataset instead of dataflow provides, basically, an instant data refresh, which now takes 1 minute.
I'd guess that there is something to look in to as to why dataflows take so long to refresh when compared to datasets when consuming the same ammount of data from the same source.
I wouldn't say that this is a solution-solution, but it works for now for our scenario.
Thank you Aniya Zhang!