Dataset not refreshing

RMM2C · ‎04-18-2020

Hello,

I have a dataset connected to 9 folders on Azure Data Lake Gen1. The folders contain CSV files and each day it is stored a new one. Therefore we have programmed the refreshing every day, right after the new files are placed. The problem is that most of the time the refresh fails, throwing out the following message:

Something went wrong
There was an error when processing the data in the dataset.
Please try again later or contact support. If you contact support, please provide these details.
Data source error: {"error":{"code":"ModelRefresh_ShortMessage_ProcessingError","pbi.error":{"code":"ModelRefresh_ShortMessage_ProcessingError","parameters":{},"details":[{"code":"Message","detail":{"type":1,"value":"Unable to connect to the remote server"}}],"exceptionCulprit":1}}} Table: XXXXXXXXXXXXXXXX
Cluster URI: XXXXXXXXXXXXXXXXXXXXXXXXXXxx
Activity ID: XXXXXXXXXXXXXXXXXXXXXXX
Request ID: XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
Time: 2020-04-18 08:46:56Z

It doesn't work using the manual refresh neither, and the table that supposedly throws the error, change from one refresh to another.
If I try to refresh the data in PBI desktop it works perfectly every single time.

Does anyone know how to fixed it?

Thank you

v-yingjl · ‎04-19-2020

Hi @RMM2C ,

There are several points you may considerate:

Your data source credential may expire, try to update the credential
If your dataset not only contains cloud data source but also the on premise data source, then it needs to use the gateway and configure schedule refresh, see more: On-premises data gateway , Configure scheduled refresh .Note that you also need to select Allow user's cloud data sources to refresh through this gateway cluster option Under Gateway Cluster Settings. See: Merge or append on-premises and cloud data sources.
Ensure that you've added one or more data sources of your dataset to the gateway, as described in Add a data source.
Please make sure the gateway is online, and try to upgrade the gateway to latest version.
Please set schedule refresh for different datasets at different times, make sure that you don't schedule more than max parallel refreshes for the different nodes in these capacities. Also we suggest that you first disable all refreshes on all capacities. Then slowly enable the refreshes one by one. Make sure refreshes are staggered apart (e.g. 1 hour apart), and that no more than max concurrent refreshes happen at overlapping time periods.

Best Regards,
Yingjie Li

If this post helps then please consider Accept it as the solution to help the other members find it more quickly.

RMM2C · ‎04-27-2020

I tried everything you say and still can't access the files. However, one of the times, the refreshing error change. Now I have two.

1st

{"error":{"code":"ModelRefresh_ShortMessage_ProcessingError","pbi.error":{"code":"ModelRefresh_ShortMessage_ProcessingError","parameters":{},"details":[{"code":"Message","detail":{"type":1,"value":"Unable to connect to the remote server"}}],"exceptionCulprit":1}}}

2nd
Unable to connect to the remote server. The exception was raised by the IDataReader interface. Please review the error message and provider documentation for further information and corrective action.