Getting on premises data into Fabric

Hi joakimfenno ,

Thanks for using Fabric Community.
Unfortunately it is not possible to use/acess on premise datagateways from notebooks. At present we can use on premise data gateway only with datapipelines and dataflow gen 2.

As an alternative, you can load your data into lakehouse from onprem using pipeline and you can perform transformation for data present in lakehouse using Notebook after loading successfully.

Docs to refer - Integrating On-Premises Data into Microsoft Fabric Using Data Pipelines in Data Factory | Microsoft Fabric Blog | Microsoft Fabric

However, your suggestion is definitely valuable! We use customer feedback like yours to prioritize future features. The more users who request the ability to customize backgrounds, the higher it moves on our list.

Appreciate if you could share the feedback on our Microsoft Fabric Ideas. Which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.

I hope this information helps. If you have any further queries please do let us know.

The use of a notebook to ingets data would be very useful, certainly for connecting to API's, Odata, etc.  Not many votes at the moment - but you can vote for this here:  Microsoft Idea 

There are ways from I've read to force the connection within the notebook, but due to security restriction - we're all locked down and using the gateway is the only way. 

Get enough votes and Microsoft may look at it.

joakimfenno - The gateway itself supports a variety of connections, including API's.  Have you tried setting up a Copy Activity that calls an API that runs On-Premise (assuming it is URL addressable) and can be added to the Gateway as a connection?

You could also look at:

- Using Azure Application Gateway (may be rebranded since I last used it) to broker the connection between an Azure Function or App Service and the On-Prem API.  Then you can call the AF from the Notebook.

- You could also look at setting up a front-end server (proxy) that has a public IP/URL that you could call from a Notebook

- Setup a Private Endpoint between an Azure Environment and the On-Prem resource, etc

I know that both of the above options require additional spend in Azure and additional management overhead.  Just throwing out options depending on how urgent the requirement is.

Jeremy