Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Calling all Data Engineers! Fabric Data Engineer (Exam DP-700) live sessions are back! Starting October 16th. Sign up.

Scheduled Refresh Issue (random)

Hi there,

 

We encounter issues when running scheduled refreshs.

This looks like a timeout issue (+60 min), but doesn't make sense as failing after 10 or 12 min.

Failing randomly on different datasets (no other logging information found), and different datasources.

 

This is critical for our production environment. Can you please help ? Thanks !

 

For example :

 

Échec de la dernière actualisation : Wed Dec 19 2018 08:10:11 GMT+0100 (Paris, Madrid)
Nous ne pouvons pas récupérer les données de la table RENAMED_MYTABLE à partir de la source de données en raison de l'expiration du délai d'attente. Vérifiez que la source de données peut traiter les requêtes d'importation. Une importation de données doit être effectuée en moins de 60 minutes.Masquer les détails
URI du cluster: WABI-NORTH-EUROPE-redirect.analysis.windows.net
ID d'activité: de31512b-f967-4e54-b3ee-ec1f4419f746
ID de demande: 1eefcd95-6831-4f5e-8f68-734aa77d71f0
Heure: 2018-12-19 07:10:11Z


Échec de la dernière actualisation : Wed Dec 19 2018 08:12:20 GMT+0100 (Paris, Madrid)
Nous ne pouvons pas récupérer les données de la table RENAMED_MYTABLE2 à partir de la source de données en raison de l'expiration du délai d'attente. Vérifiez que la source de données peut traiter les requêtes d'importation. Une importation de données doit être effectuée en moins de 60 minutes.Masquer les détails
URI du cluster: WABI-NORTH-EUROPE-redirect.analysis.windows.net
ID d'activité: de31512b-f967-4e54-b3ee-ec1f4419f746
ID de demande: 4e5cf852-d44a-4a07-af0a-f1779299a4d0
Heure: 2018-12-19 07:12:20Z

Status: New
Comments
v-qiuyu-msft
Community Support

Hi @Anonymous,

 

The issue should be related to this known issue listed in Support site: 

 

q2.PNG

 

Best Regards,
Qiuyun Yu

Anonymous
Not applicable

Hi @v-qiuyu-msft,

 

Thanks for your answer. It is not exactly the message I get (timeout on datasources, no reference to gateway), but it could be related. Do you have any way to ensure it is, not to waste time if it's not Smiley Wink ?

 

Kind Regards,

Kevin L.

 

v-qiuyu-msft
Community Support

Hi @Anonymous,

 

Yes, I know it's not exactly match. But I found the DM_GWPipeline_Client_GatewayUnreachable error in internal trace for your dataset refresh, I guess should be related to this known issue. 

 

I checked it again just now, the dataset was refreshed successfully on two scheduled time on 12/20/2018. It looks like issue doesn't happen again. 

 

You can monitor dataset refresh these days to check if the issue happens again. 

 

Best Regards,
Qiuyun Yu 

Anonymous
Not applicable

Hi @v-qiuyu-msft,

 

Thanks for your kind feedback. Actually I still encounter this issue these days, so I hope that this issue will be solved very soon. Waiting to hear from you, I wish you happy celebrations.

KR,

Kevin

v-qiuyu-msft
Community Support

Hi @Anonymous,

 

The known issue mentioned before is gone in Support site. If you still have issue, please share new error information. 

 

Best Regards,
Qiuyun Yu 

Anonymous
Not applicable

Hi @v-qiuyu-msft,

Please find below the most recent related ones. Have a nice day.

Kind Regards,

Kevin


URI du cluster: WABI-NORTH-EUROPE-redirect.analysis.windows.net
ID d'activité: e30a25c1-f696-41c0-abf7-02fb2da85da8
ID de demande: aa4a57a1-7353-48d8-b6f9-de7e7f8e53f5
Heure: 2018-12-25 07:21:35Z

 

URI du cluster: WABI-NORTH-EUROPE-redirect.analysis.windows.net
ID d'activité: e30a25c1-f696-41c0-abf7-02fb2da85da8
ID de demande: fac58113-c9f8-48a8-a962-34b37ed6e85f
Heure: 2018-12-25 07:05:23Z

 

 

v-qiuyu-msft
Community Support

Hi @Anonymous,

 

I find the issue happens around schedule time 7:00 AM intermittently, the other schedule time doesn't have this issue. Please check if there are many datasets scheduled to refresh at 7:00 AM. Please try to decrease dataset volume at 7:00 AM. 

 

Best Regards,
Qiuyun Yu

Anonymous
Not applicable

Hi @v-qiuyu-msft,

 

To be honest, I can not decrease much more the volume (4 refreshs per interval of 30 min).

I can see also that the error occurs not so often than last weeks, but still persists sometimes even at the pm refresh as below:

 

BR,

Kevin

 

URI du cluster:WABI-NORTH-EUROPE-redirect.analysis.windows.net
ID d'activité:e079923d-29fa-4bb0-9fab-51fabfabc678
ID de demande:f849c19a-e049-4a8e-9b55-9ad3cf1612cc
Heure:2018-12-29 13:20:55Z
v-qiuyu-msft
Community Support

Hi @Anonymous,

 

It's hard to provide further support on forum side. I would suggest you create a support ticket to let engineers look into the issue on your side. 

 

Support Ticket.gif

 

Best Regards,
Qiuyun Yu 

Anonymous
Not applicable

Hi @v-qiuyu-msft,

 

I have opened a ticket as proposed. Thanks for your help.

 

BR,

Kevin