topic Re: Installing a Data Gateway in Dataflow

Installing a Data Gateway

SergioSurfer — Fri, 20 Sep 2024 10:16:29 GMT

I'm trying to connect to a SAP database using Dataflows Gen 2, however it requests an On-premises Data Gateway.

I've read a lot about these data gateways. I need to install it on a computer that is ON all the time, which is something that I do not have. I'm assuming that the ideal solution would be to install the gateway on the same machine that is hosting the SAP database? What if I don't have any way of doing this? Is there any solution where Microsoft Fabric can 'host' these data gateways so we don't have to worry about installing in some computers just for the gateway?

Thanks in advance

Re: Installing a Data Gateway

NandanHegde — Fri, 20 Sep 2024 13:48:19 GMT

Unfortunately it is not recommended to install a gateway on the same server as that on the database. And unfortunately there is no direct component within Fabric to handle that as of today.

https://learn.microsoft.com/en-us/data-integration/gateway/

The Vnet gateway is for MSFt cloud services connectivity.

So you wuld have to set up a server within the same vent as the database and host a gateway on that new server

Re: Installing a Data Gateway

SergioSurfer — Fri, 20 Sep 2024 15:54:33 GMT

Reading the resources you shared: What is a virtual network (VNet) data gateway | Microsoft Learn
I see that the limitations of this mention the following:

1) "Currently, this feature is available only for Fabric Dataflow Gen2, Power BI semantic models, Power Platform dataflows, and Power BI paginated reports."
2) "Power Platform dataflows - For Power Platform dataflows, this feature currently doesn't support the ability to write to a privatized data lake or Dataverse."

--> Does this mean that I wouldn't be able to use the Notebook with PySpark to access a SAP Hana database and put the data onto OneLake?

Re: Installing a Data Gateway

Anonymous — Mon, 23 Sep 2024 01:17:54 GMT

Hi SergioSurfer ,

Based on the limitations you’ve mentioned, it seems that the virtual VNet data gateway currently supports only specific services like Fabric Dataflow Gen2, Power BI semantic models, Power Platform dataflows, and Power BI paginated reports.

Since your use case involves using a Notebook with PySpark to access a SAP Hana database and then putting the data onto OneLake, it falls outside the supported scenarios for the VNet data gateway. The gateway does not currently support writing to a privatized data lake or Dataverse for Power Platform dataflows. Therefore, you wouldn’t be able to use the VNet data gateway for your specific requirements.

Best Regards

Yilong Zhou

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Re: Installing a Data Gateway

SergioSurfer — Mon, 23 Sep 2024 07:50:39 GMT

What would be the best way then for me to gather some data from SAP hana database into OneLake?

Re: Installing a Data Gateway

charlyS — Wed, 09 Oct 2024 09:51:12 GMT

Easiest way will certainly be using a Dataflow Gen2 https://learn.microsoft.com/en-us/fabric/data-factory/connector-sap-hana

No need to have a machine up and runnning all time for the usage of a Fabric Gateway, it just need to be up and running while you are retrieving the data.

Hope this help,