Forum Discussion

Syndicate_Admin's avatar
Syndicate_Admin
Icon for Administrator rankAdministrator
2 years ago

Microsf Fabric - How to handle timeout when making GET requests in Microsoft Fabric?

¡Hola everyone! I'm facing an issue while trying to download a zip file from a URL using Microsoft Fabric. My goal is to parse a CSV file contained in this zip using PySpark. However, I encounter a ...
Anonymous's avatar
Anonymous
Not applicable
2 years ago

Hi Syndicate_Admin 

1.Based on your description, you can consider to extend your setting of the connect_timeout and read_timeout to test if they can receive the data.

2.Check that if your dataset is large that it will affect the performance, you can consider to optimize the data model.

 

Best Regards!

Yolo Zhu

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Syndicate_Admin's avatar
Syndicate_Admin
Icon for Administrator rankAdministrator
2 years ago

I tried to fix this by adjusting spark.network.timeout, but the process still stops at 2 minutes and 12 seconds. I can't find where this time limit is set. Do you have any idea where it might be defined?