Skip to main content
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Be one of the first to start using Fabric Databases. View on-demand sessions with database experts and the Microsoft product team to learn just how easy it is to get started. Watch now

PabloBC

DATAFLOW error when refresh data from gbq. code: UNAVAILABLE message: GOAWAY received

Submitted by on ‎10-08-2024 09:16 AM

Trying to refresh my dataflow around 7 GB and receive this error

 

Error: Data Source Error : DataSource.Error: ERROR [HY000] [Microsoft][BigQuery] (310) Storage API Error: Error: { code: UNAVAILABLE message: GOAWAY received }. RootActivityId = 7cb7e226-dd8b-4ed1-8773-f87682630a9a.Param1 = DataSource.Error: ERROR [HY000] [Microsoft][BigQuery] (310) Storage API Error: Error: { code: UNAVAILABLE message: GOAWAY received } Request ID: f2f40ebc-4e93-8329-7f93-c5d1bfef9f77.

 

data comes from GOogle big query. I am admin and no quota assigned.

 

i have tried different timeouts.

 

Updates in dataflow are very irregular

 

Trying to refresh my dataflow around 7 GB and receive this error

 

Error: Data Source Error : DataSource.Error: ERROR [HY000] [Microsoft][BigQuery] (310) Storage API Error: Error: { code: UNAVAILABLE message: GOAWAY received }. RootActivityId = 7cb7e226-dd8b-4ed1-8773-f87682630a9a.Param1 = DataSource.Error: ERROR [HY000] [Microsoft][BigQuery] (310) Storage API Error: Error: { code: UNAVAILABLE message: GOAWAY received } Request ID: f2f40ebc-4e93-8329-7f93-c5d1bfef9f77.

Status: Investigating

Hi @PabloBC ,

 

Based on the error message above,Please ensure that your network connection is stable and not experiencing high latency or packet loss.
You may also optimize Data Queries,If the data you’re trying to refresh is very large or complex, consider optimizing your queries to reduce the load on the server.
Even though you mentioned no quota is assigned, it’s worth double-checking if there are any implicit limits or if the project might be hitting other resource limits.
Your credentials have to be up-to-date, especially if you’re using scheduled queries or data transfers.

 

Best regards.
Community Support Team_Caitlyn

See more ideas labeled with:
3 Comments (3 New)
Comments
v-xiaoyan-msft
Community Support
Community Support
‎10-09-2024 12:07 AM
Status changed to: Investigating

Hi @PabloBC ,

 

Based on the error message above,Please ensure that your network connection is stable and not experiencing high latency or packet loss.
You may also optimize Data Queries,If the data you’re trying to refresh is very large or complex, consider optimizing your queries to reduce the load on the server.
Even though you mentioned no quota is assigned, it’s worth double-checking if there are any implicit limits or if the project might be hitting other resource limits.
Your credentials have to be up-to-date, especially if you’re using scheduled queries or data transfers.

 

Best regards.
Community Support Team_Caitlyn

PabloBC
New Member
‎10-09-2024 10:08 AM

Not very useful. Before I wrote that i did all the research needed. I need something more specific and technical.

 

THankS

HI1
Frequent Visitor
‎10-09-2024 12:04 PM

I'm also running into the same issue, and suspect it might be general system-wide problems...a dataflow that's been fairly stable and consistent gave me this error after I noticed some other unrelated processes failing with a separate error (that one was: Error: PipelineException: Container exited unexpectedly with code 0x0000DEAD).

 

Worked to clear those problems by manually triggering On Demand updates, with the first attempt passing a different message (Error: Evaluation resulted in a stack overflow and cannot continue.), and then the second attempt succeeding as it had been regularly doing on a daily basis for a long time up until this week.

 

Following that, other Linked-source updates also required manually being retriggering to cascade successful completion, at which point I found this message: (DataSource.Error: ERROR [HY000] [Microsoft][BigQuery] (310) Storage API Error: Error: { code: UNAVAILABLE message: GOAWAY received }).

Idea Statuses