Forum Discussion

ntimmerman's avatar
ntimmerman
Helper I
1 year ago
Solved

Dataflowgen2 copy from SFTP location error

Hi Community,

 

Since a day or so, I am getting this error message when Copying JSON files to a Lakehouse via a copy data activity:

ErrorCode=SftpNetworkIssue,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=Meet network issue when connect to Sftp server '*****.sftp.wpengine.com', SocketErrorCode: 'ConnectionReset'.,Source=Microsoft.DataTransfer.ClientLibrary.SftpConnector,''Type=System.Net.Sockets.SocketException,Message=An existing connection was forcibly closed by the remote host,Source=Renci.SshNet,'

The strange thing is that this used to work without a problem. Any idea of what I can do to make this work again?

I read on other forms that this error can happen randomly but even after 10 retries it still fails consitently.

 

Any help is greatly appreciated,

Nico

  • ntimmerman's avatar
    ntimmerman
    1 year ago

    Based on the support I received from Microsoft I changed the degree of Copy parallelism to 1 and this fixed the issue! 

     

3 Replies