Dataflow Operation Timeout with Incremental refresh of Azure Table Storage

[martinlingstuyl]

Hi,

I've got a Dataflow connected to an Azure Table Storage table. I've setup Incremental Refresh a year ago, and it's been updating every night. It's incrementally refreshing the last 7 days and stores the data for maximum of two years. The Table contains roughly 9 million records.

Now we've recently run into timeouts when refreshing the data. The Refresh will fail 9 out of 10 times after running between 20 and 90 minutes. The error is as follows: 

DataSource.Error: AzureTables: Request failed: The operation has timed out. DataSourceKind = AzureTables DataSourcePath = https://<name>.table.core.windows.net/

It's unclear to me what the reason could be and how we can fix it.

I really hope someone here has ideas!

Kind regards,

Martin

[martinlingstuyl]

Hi, 

Thanks for your response!
Unfortunately, the Azure Table Storage connector does not seem to have the possibility to set a Timeout value.

Martin

[v-jingzhang]

Hi @martinlingstuyl 

Please check if this similar thread helps: 

Solved: Dataflow - Status Failed - Timeout Error - Microsoft Power BI Community

Other references:

https://stackoverflow.com/questions/51718344/how-to-set-a-max-run-time-timeout-for-power-query

Best Regards,
Community Support Team _ Jing Zhang
If this post helps, please consider Accept it as the solution to help other members find it.