Forum Discussion

nicworth's avatar
nicworth
Regular Visitor
2 years ago
Solved

Connection to FTP Server using explicit FTP over TLS

Hi All,

I am trying to setup a pipeline to ingest CSV files from a vendors FTP server, the current connection type they only allow is 'Explicit FTP over TLS' so it is a FTP connection and not SFTP (Using Host Key Finger-print). Here is where I am having a problem, it appears that the connector in Fabric does not support the explicit over TLS. The options you have for the FTP connection are very basic its just the host, port and authentication method (basic or anoynmous). I have tried to specify the FTP explicit protocol as part of the hostname "ftpes://" but when I try and use this I get the following error when trying to retrieve the file list "Access 'ftpes://<hostname>' is not allowed on Azure integrate runtime.".

 

I have tested this within Azure Data Factory and setup a linked service to the same vendor FTP server and this works fine as the connector in Azure Data Factory has additional options for SSL etc, please see below for reference - 

 

So how can I overcome this issue in Fabric? or will my integration solution need to leverage Azure Data Factory to move the files from FTP to a Blob Storage Account and then setup the Pipeline in Fabric to ingest from the Blob Storage Account? 

 

Any help or guidance will be greatly appreciated. 

 

Thanks

 

Pipelines
  • Anonymous's avatar
    Anonymous
    2 years ago

    Hi nicworth ,

    In that case, you can load data to ADLS Gen 2 or Blob Storage using ADF and later you can use Fabric Pipelines to pull the data from ADLS Gen2 to Lakehouse.

    However, your suggestion is definitely valuable! We use customer feedback like yours to prioritize future features. The more users who request the ability to customize backgrounds, the higher it moves on our list.

     

    Appreciate if you could share the feedback on our Microsoft Fabric Ideas. Which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.

     

    I hope this information helps. If you have any further queries please do let us know.

8 Replies

    • nicworth's avatar
      nicworth
      Regular Visitor
      2 years ago

      Hi,

      It is not SFTP, it is an explicit TLS FTP protocol that is only supported by the vendor system. Protocol "ftpes://", as said this is achieveable in ADF but it appears the connector in Fabric Data Factory does not have the same features unfortunately.

       

      Thanks

      Nic

      • Anonymous's avatar
        Anonymous
        Not applicable
        2 years ago

        Hi nicworth ,

        In that case, you can load data to ADLS Gen 2 or Blob Storage using ADF and later you can use Fabric Pipelines to pull the data from ADLS Gen2 to Lakehouse.

        However, your suggestion is definitely valuable! We use customer feedback like yours to prioritize future features. The more users who request the ability to customize backgrounds, the higher it moves on our list.

         

        Appreciate if you could share the feedback on our Microsoft Fabric Ideas. Which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.

         

        I hope this information helps. If you have any further queries please do let us know.