Forum Discussion

martinlingstuyl's avatar
martinlingstuyl
New Member
5 years ago

Dataflow Operation Timeout with Incremental refresh of Azure Table Storage

Hi,

 

I've got a Dataflow connected to an Azure Table Storage table. I've setup Incremental Refresh a year ago, and it's been updating every night. It's incrementally refreshing the last 7 days and stores the data for maximum of two years. The Table contains roughly 9 million records.

 

Now we've recently run into timeouts when refreshing the data. The Refresh will fail 9 out of 10 times after running between 20 and 90 minutes. The error is as follows: 

DataSource.Error: AzureTables: Request failed: The operation has timed out. DataSourceKind = AzureTables DataSourcePath = https://<name>.table.core.windows.net/

 

It's unclear to me what the reason could be and how we can fix it.

 

I really hope someone here has ideas!

 

Kind regards,

Martin

2 Replies