Forum Discussion

joakimfenno's avatar
joakimfenno
Icon for Helper V rankHelper V
2 years ago

Getting on premises data into Fabric

I am wondering what the differemt alternatives to securely enable on premises data sources to Microsoft Fabric are.   I have used On Premise Datagateway which works for ingesting data using data pi...
Need Help
jwinchell40's avatar
jwinchell40
Icon for Resolver III rankResolver III
1 year ago

joakimfenno - The gateway itself supports a variety of connections, including API's.  Have you tried setting up a Copy Activity that calls an API that runs On-Premise (assuming it is URL addressable) and can be added to the Gateway as a connection?

 

You could also look at:

 

- Using Azure Application Gateway (may be rebranded since I last used it) to broker the connection between an Azure Function or App Service and the On-Prem API.  Then you can call the AF from the Notebook.

- You could also look at setting up a front-end server (proxy) that has a public IP/URL that you could call from a Notebook

- Setup a Private Endpoint between an Azure Environment and the On-Prem resource, etc

 

I know that both of the above options require additional spend in Azure and additional management overhead.  Just throwing out options depending on how urgent the requirement is.

 

Jeremy

  • joakimfenno's avatar
    joakimfenno
    Icon for Helper V rankHelper V
    1 year ago

    Yes, I have tried data pipeline - copy data.

    It works but it comes with a lot of overhead

    I would prefer to use notebook

     

    Azure Application Gateway/azure functions could be an option even though I would need to recode my ingestion - do you have any reference material?

     

    we are not allowed to expose sources with public IP/URL

     

    privcate endpoint might be an option, is it supported with fabric - do you have any reference material?