DATAFLOW error when refresh data from gbq. code: UNAVAILABLE message: GOAWAY received

[Anonymous]

Trying to refresh my dataflow around 7 GB and receive this error

Error: Data Source Error : DataSource.Error: ERROR [HY000] [Microsoft][BigQuery] (310) Storage API Error: Error: { code: UNAVAILABLE message: GOAWAY received }. RootActivityId = 7cb7e226-dd8b-4ed1-8773-f87682630a9a.Param1 = DataSource.Error: ERROR [HY000] [Microsoft][BigQuery] (310) Storage API Error: Error: { code: UNAVAILABLE message: GOAWAY received } Request ID: f2f40ebc-4e93-8329-7f93-c5d1bfef9f77.

data comes from GOogle big query. I am admin and no quota assigned.

i have tried different timeouts.

Updates in dataflow are very irregular

Trying to refresh my dataflow around 7 GB and receive this error

Error: Data Source Error : DataSource.Error: ERROR [HY000] [Microsoft][BigQuery] (310) Storage API Error: Error: { code: UNAVAILABLE message: GOAWAY received }. RootActivityId = 7cb7e226-dd8b-4ed1-8773-f87682630a9a.Param1 = DataSource.Error: ERROR [HY000] [Microsoft][BigQuery] (310) Storage API Error: Error: { code: UNAVAILABLE message: GOAWAY received } Request ID: f2f40ebc-4e93-8329-7f93-c5d1bfef9f77.

[Anonymous]

Hi @Anonymous ,

Based on the error message above,Please ensure that your network connection is stable and not experiencing high latency or packet loss.
You may also optimize Data Queries,If the data you’re trying to refresh is very large or complex, consider optimizing your queries to reduce the load on the server.
Even though you mentioned no quota is assigned, it’s worth double-checking if there are any implicit limits or if the project might be hitting other resource limits.
Your credentials have to be up-to-date, especially if you’re using scheduled queries or data transfers.

Best regards.
Community Support Team_Caitlyn

[Anonymous]

Not very useful. Before I wrote that i did all the research needed. I need something more specific and technical.

THankS

[Anonymous]

I'm also running into the same issue, and suspect it might be general system-wide problems...a dataflow that's been fairly stable and consistent gave me this error after I noticed some other unrelated processes failing with a separate error (that one was: Error: PipelineException: Container exited unexpectedly with code 0x0000DEAD).

Worked to clear those problems by manually triggering On Demand updates, with the first attempt passing a different message (Error: Evaluation resulted in a stack overflow and cannot continue.), and then the second attempt succeeding as it had been regularly doing on a daily basis for a long time up until this week.

Following that, other Linked-source updates also required manually being retriggering to cascade successful completion, at which point I found this message: (DataSource.Error: ERROR [HY000] [Microsoft][BigQuery] (310) Storage API Error: Error: { code: UNAVAILABLE message: GOAWAY received }).