Can't use Folder connector with on-premises data gateway

[AzGharbi]

Hello,

We are trying to copy a file from a Lakehouse to a folder using "Copy Data" activity in a pipeline.
We are using Folder connector with our on-premise data gateway to connect to destination.
The connection is successfully established.

But when I execute the pipeline, I am getting this error:

I usually solve this type of error by enabling this option by editing the connection:

But I can't select this option because it is grayed out.
This connector should work with the on premise gateway as described in the documentation.
https://learn.microsoft.com/en-us/fabric/data-factory/connector-folder-overview

Did I miss something ?
Can anyone point me in the right direction?

Regards

[tayloramy]

Hi @FrozenFritz, 

I just made a new copy data activity in a new pipeline (note this is different from a copy job, which is its own artifact) in my environment to see if I can replicate this, and I can. 

So it does seem that these lakehouse connections need to have that on prem data gateway checkbox checked. 

What exact permissions do you have on the gateway, and on the workspace? 

In my enviornment for lakehouse connections, that box is checkable. It is not checkable for warehouse connections however. 

If you found this helpful, consider giving some Kudos. If I answered your question or solved your problem, mark this post as the solution.

[tayloramy]

Hi @AzGharbi @FrozenFritz, 

Do you have connection creator permissions on the gateway? 

FOr the connection to the lakehouse - don't use the gateway, it's not needed and will only cause problems. 

For the connection to the source file, that needs to be a gateway connection to access your on prem env. Creating the connection directly on the gateway in the manage connections and gateways page should allow you to do this. 

If you found this helpful, consider giving some Kudos. If I answered your question or solved your problem, mark this post as the solution.

[FrozenFritz]

Hi @tayloramy,

thanks for the reply. I do have the permissions to create connections in the settings section. For the source file this is exactly what i've done to get my files from my on prem servers. Any old Copy Jobs which i've created before are working as expected on Connections targeting folder shares on the servers.

The problem occurs on new Copy Jobs ( and i think they changed them as well because the destination part needs now a connection too ) which are using a new connection targeting a folder.

New Copy Job ( which fails )

Source settings:

Destination settings:

Errror message:

Old Copy Job on an old connection, created months ago:

Source settings:

Destination settings:

[AzGharbi · Accepted solution]

I did find the solution.
I was focusing on the wrong part. The issue was not from the destination connection but from the source connection.
It is the normal behavior to not be able to tick the option to "Allow this connection to be used with gateways" when you configure a connection going through the gateway.
The connection is implicitly allowed, because you are using a gateway to connect to your on prem network!

To solve the issue, check if the source connection is allowed to be used with gateway.

Thanks to anyone who tried to help
Regards

[FrozenFritz]

Interesting! I it figured out too at the same time! 🥳 
I find the error message kind of misleading. Great we both solved our errors 😉

[v-saisrao-msft]

Hi @AzGharbi,

Go to Settings → Manage connections and gateways → New connection, choose On-premises, select your gateway cluster, and set up the Folder connection using Windows authentication.
Afterwards, update your pipeline to use this connection and run it again to resolve the gateway error.

How to access on-premises data sources in Data Factory - Microsoft Fabric | Microsoft Learn

Thank you.

[FrozenFritz]

Hi! Im facing the same issue as AzGharbi. We ensured every setting the error message mentions but nothin does work. Do you have any other suggestions on this?

Regards

[AzGharbi]

Hello,
I tried your solution but i still get the same error because when i create the connection because cannot enable "Allow this connection to be used with gateways". The checkbox is not available when creating the connection