topic Lakehouse validation of the connection hangs in Dataflow

Lakehouse validation of the connection hangs

marcoG — Fri, 16 Jun 2023 08:35:20 GMT

I have installed the latest version of the gateway(3000.178.9).
The on premise input connection works while the connection to the lakehouse hangs(VERY SLOW) on validation (both with and without gateway)

Re: Lakehouse validation of the connection hangs

marcoG — Fri, 16 Jun 2023 08:49:45 GMT

The data arrives in the staging area but not in the lakehouse I don't understand what the logic is?

Error: WriteToDatabaseTableFrom_TransformForOutputToDatabaseTableFrom_

null Error: Couldn't refresh the entity because of an issue with the mashup document MashupException.Error: Microsoft SQL: A network-related or instance-specific error occurred while establishing a connection to SQL Server. The server was not found or was not accessible. Verify that the instance name is correct and that SQL Server is configured to allow remote connections. (provider: Named Pipes Provider, error: 40 - Could not open a connection to SQL Server) Details: DataSourceKind = Lakehouse;DataSourcePath = Lakehouse;Message = A network-related or instance-specific error occurred while establishing a connection to SQL Server. The server was not found or was not accessible. Verify that the instance name is correct and that SQL Server is configured to allow remote connections. (provider: Named Pipes Provider, error: 40 - Could not open a connection to SQL Server);ErrorCode = -2146232060;Number = 53;Class = 20 GatewayObjectId: 305f0d41-e624-4c13-b947-0f2761403cb7. .

Re: Lakehouse validation of the connection hangs

miguel — Sun, 18 Jun 2023 00:51:29 GMT

Hey!

I suggest reaching out to the support team by raising a new support ticket.

The team would be able to dig deeper to figure out what could be the situation.

Re: Lakehouse validation of the connection hangs

miguel — Mon, 19 Jun 2023 16:00:27 GMT

What could be happening is that you may have a firewall rule that prevents data being moved by the Gateway from the staging lakehouse to its final destination.

Please reach out to our support to create a support ticket and have an engineer look at this situation.

Re: Lakehouse validation of the connection hangs

marcoG — Tue, 20 Jun 2023 06:52:21 GMT

Hi miguel ,
if the data arrived at the cloud (in the staging area) through a gateway,

why should it now return to the premise to then reach the final destination (lakehouse)?

Another thing the gateway, by definition, must have only one opening of doors towards the gateway
and not open the doors for each lake house otherwise what is it the gateway for?

Re: Lakehouse validation of the connection hangs

miguel — Tue, 20 Jun 2023 07:06:09 GMT

The Gateway is effectively the engine doing all the moving and transformation of the data.

I'm not sure I follow the last question. Could you please rephrase it?

For this specific scenario, I'd recommend reaching out to our support team so they can do a more thorough investigation.