topic Re: Unable to load data into Lakehouse in Data Engineering

Unable to load data into Lakehouse

milosha — Tue, 10 Dec 2024 10:56:25 GMT

Hi all

We are using Dataflow Gen2 to load data from db running in Azure using data gateway.

We solved the loading issues with separating the inbound dataflow into two parts as per this article.

Later we udpated the firewall rules as per the same article and now the dataflow gen2 is able to grab the data from source DB and connect to the target lakehouse, however, in the very last step we get this error:

Something went wrong while retrieving the list of tables. Please try again later.: An exception occurred: Microsoft SQL: A connection was successfully established with the server, but then an error occurred during the login process. (provider: SSL Provider, error: 0 - An existing connection was forcibly closed by the remote host.)

This sounds to me like an authentication errror, but I am able to connect to the Lakehouse from Azure Data Studio with the same account used by Dataflow.

We get the same error in the original lakehouse (using the two-part dataflow workaround) and in a completely new, test lakehouse.

Any ideas?

thanks!

Re: Unable to load data into Lakehouse

Anonymous — Thu, 12 Dec 2024 07:43:45 GMT

Hi @milosha ,

This error occurs when you try to establish an encrypted connection with SQL Server using a non-verifiable certificate.

You can try the following steps to resolve this issue:

Ensure that your network connection is stable and that you are not experiencing any interruptions.

Make sure that no firewalls or network security tools (such as VPN or proxy settings) are blocking access to the Dataflow Gen2 server.

If you are connecting using SSL/TLS, make sure the certificate is configured correctly and trusted. An incorrectly configured certificate can cause handshake errors. You can review this documentation:

Error message when you connect to SQL Server - SQL Server | Microsoft Learn

Sometimes a temporary problem can be resolved by simply retrying the connection.

If you have any other questions please feel free to contact me.

Best Regards,
Yang
Community Support Team

If there is any post helps, then please consider Accept it as the solution to help the other members find it more quickly.
If I misunderstand your needs or you still have problems on it, please feel free to let us know. Thanks a lot!

Re: Unable to load data into Lakehouse

milosha — Thu, 12 Dec 2024 07:25:59 GMT

Hello Yang,

thanks for the advice. However I am not sure how to check or implement any of those points. Both Dataflows and Lakehouse are platform services, I am not aware of any of the configuration options you mentioned above. Can you elaborate more, please?