Connection to FTP Server using explicit FTP over TLS

[nicworth]

Hi All,

I am trying to setup a pipeline to ingest CSV files from a vendors FTP server, the current connection type they only allow is 'Explicit FTP over TLS' so it is a FTP connection and not SFTP (Using Host Key Finger-print). Here is where I am having a problem, it appears that the connector in Fabric does not support the explicit over TLS. The options you have for the FTP connection are very basic its just the host, port and authentication method (basic or anoynmous). I have tried to specify the FTP explicit protocol as part of the hostname "ftpes://" but when I try and use this I get the following error when trying to retrieve the file list "Access 'ftpes://<hostname>' is not allowed on Azure integrate runtime.".

I have tested this within Azure Data Factory and setup a linked service to the same vendor FTP server and this works fine as the connector in Azure Data Factory has additional options for SSL etc, please see below for reference - 

So how can I overcome this issue in Fabric? or will my integration solution need to leverage Azure Data Factory to move the files from FTP to a Blob Storage Account and then setup the Pipeline in Fabric to ingest from the Blob Storage Account? 

Any help or guidance will be greatly appreciated. 

Thanks

[Anonymous]

Hi @nicworth ,

Thanks for using Fabric Community.
If you are looking for SFTP connectivity, can you please check this - SFTP connector overview - Microsoft Fabric | Microsoft Learn

Hope this is helpful. Please do let me know incase of further queries.

[nicworth]

Hi,

It is not SFTP, it is an explicit TLS FTP protocol that is only supported by the vendor system. Protocol "ftpes://", as said this is achieveable in ADF but it appears the connector in Fabric Data Factory does not have the same features unfortunately.

Thanks

Nic

[Kaviraj11]

I'm facing the same issue here. Let me know when you come across the solution. Would be much appreciated. 

[Anonymous · Accepted solution]

Hi @nicworth ,

In that case, you can load data to ADLS Gen 2 or Blob Storage using ADF and later you can use Fabric Pipelines to pull the data from ADLS Gen2 to Lakehouse.

However, your suggestion is definitely valuable! We use customer feedback like yours to prioritize future features. The more users who request the ability to customize backgrounds, the higher it moves on our list.

Appreciate if you could share the feedback on our Microsoft Fabric Ideas. Which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.

I hope this information helps. If you have any further queries please do let us know.

[Anonymous]

Hi @nicworth ,

We haven’t heard from you on the last response and was just checking back to see if your query was answered.
Otherwise, will respond back with the more details and we will try to help .

Thanks

[Anonymous]

Hi @nicworth ,

We haven’t heard from you on the last response and was just checking back to see if your query was answered.
Otherwise, will respond back with the more details and we will try to help .

Thanks

[nicworth]

Hi,

Apologies for the late response, yes you have answered my query. We will use ADF connecting to ADLS gen2 to ingest the data for the time being. I will also see if I can submit the feature/enhancement request as you have advised. 

Thanks

Nic

[nicworth]

I have submitted the enhancement/idea as suggested. 

https://ideas.fabric.microsoft.com/ideas/idea/?ideaid=567f7bc4-0428-ef11-8ee7-6045bd7cb0bf