topic Re: Dataflowgen2 copy from SFTP location error in Data Engineering

Dataflowgen2 copy from SFTP location error

ntimmerman — Wed, 05 Mar 2025 23:54:56 GMT

Hi Community,

Since a day or so, I am getting this error message when Copying JSON files to a Lakehouse via a copy data activity:

ErrorCode=SftpNetworkIssue,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Meet network issue when connect to Sftp server '*****.sftp.wpengine.com', SocketErrorCode: 'ConnectionReset'.,Source=Microsoft.DataTransfer.ClientLibrary.SftpConnector,''Type=System.Net.Sockets.SocketException,Message=An existing connection was forcibly closed by the remote host,Source=Renci.SshNet,'

The strange thing is that this used to work without a problem. Any idea of what I can do to make this work again?

I read on other forms that this error can happen randomly but even after 10 retries it still fails consitently.

Any help is greatly appreciated,

Nico

Re: Dataflowgen2 copy from SFTP location error

lbendlin — Thu, 06 Mar 2025 01:14:50 GMT

Stop guessing, start ticketing.

If you have a Pro license you can open a Pro ticket at https://admin.powerplatform.microsoft.com/newsupportticket/powerbi
Otherwise you can raise an issue at https://community.fabric.microsoft.com/t5/Issues/idb-p/Issues .

Re: Dataflowgen2 copy from SFTP location error

ntimmerman — Fri, 07 Mar 2025 05:58:33 GMT

Thanks,

I've just created a support request

Re: Dataflowgen2 copy from SFTP location error

ntimmerman — Tue, 11 Mar 2025 04:25:42 GMT

Based on the support I received from Microsoft I changed the degree of Copy parallelism to 1 and this fixed the issue!