topic Re: Custom IP/Data Factory Runtime in Pipelines

Custom IP/Data Factory Runtime

BW_RFA — Thu, 08 Feb 2024 15:33:41 GMT

Hello,

I am connecting to an FTP server with a firewall. I am wary of allowing all IP address ranges to copy the data using Fabric Data Factory as per https://learn.microsoft.com/en-us/azure/data-factory/azure-integration-runtime-ip-addresses#azure-integration-runtime-ip-addresses-specific-regions.

Is there a way to create a custom runtime/ip that I can add to the server firewall so that it is not accessible by every Data Factory user?

Any other suggestions welcome.

Re: Custom IP/Data Factory Runtime

NandanHegde — Thu, 08 Feb 2024 16:19:48 GMT

Hey BW_RFA

Abhishek is from the MSFT Fabric product team , so it would be more correct as to how they have designed.

https://community.fabric.microsoft.com/t5/Data-Pipelines/Enabling-Azure-Data-Factory-to-Access-Restricted-REST-API-and/m-p/3310151

So I guess unlike PowerBI, for data pipelines ; The integration runtime is shared across the PaaS and SaaS version.

But to have a signle IP;

the best way would be to use a onpremises gateway to access the SFTP.

Since the gateway would be installed on a server which would have only 1 private IP which we can whitelist:

https://learn.microsoft.com/en-us/power-bi/connect-data/service-gateway-onprem

Re: Custom IP/Data Factory Runtime

BW_RFA — Thu, 08 Feb 2024 16:07:18 GMT

Hi Nandan,

Thanks for your response.

https://community.fabric.microsoft.com/t5/Data-Pipelines/Enabling-Azure-Data-Factory-to-Access-Restricted-REST-API-and/m-p/3310151 This forum mentions the Fabric Data Factory uses the same runtime as ADF?

Re: Custom IP/Data Factory Runtime

NandanHegde — Thu, 08 Feb 2024 16:21:15 GMT

Hey,

I have updated the ans.

SInce ABhishek is from MSFT Product team developing the Fabric data pipelines, they know the design. So the IPs are being shared.

But to have a single IP, in ADF we leverage Self hosted integration runtime and the equivalent of that in Fabric data pipeline is onpremises data gateway

Re: Custom IP/Data Factory Runtime

v-cboorla-msft — Tue, 13 Feb 2024 12:21:31 GMT

Hi BW_RFA

Thanks.

Re: Custom IP/Data Factory Runtime

v-cboorla-msft — Fri, 16 Feb 2024 05:21:21 GMT

Hi BW_RFA

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others.
If you have any question relating to the current thread, please do let us know and we will try out best to help you.
In case if you have any other question on a different issue, we request you to open a new thread.

Thanks.