Forum Discussion
How to connect to an external API data source that needs ip whitelisting?
- 1 year ago
We too had this issue, and have solved it relatively simply in the end.
The idea is to set up a VNet Data Gateway in Azure, then put it in a subnet fronted with a NAT Gateway which can be configured to have whatever IP address you need.
- Create a VNet Data Gateway: https://learn.microsoft.com/en-us/data-integration/vnet/create-data-gateways
- Create the NAT Gateway and give it a fixed IP address: https://learn.microsoft.com/en-us/azure/nat-gateway/quickstart-create-nat-gateway-portal
- Create a Web/HTTPS activity from Fabric and route it via the VNet Data Gateway:
- 1 year ago
Hi,
Eventually all proposed solutions did not work for us, but we figured it out with a very simple solution, logic app!
what we did:
- Logic app:
- Create a logic app in Azure with a "When an HTTP request is received" trigger . We added a JSON schema for the dynamic parts from our notebook in Fabric (e.g. endpoints and auth token)
- Add HTTP action and built with the dynamic parts from the above trigger
- Add response action.
- Then we whitelisted all outgoing ip adresses from the logic app (found under settings > properties) in the external API
- Lastly, we put the logic app url in our fabric notebook and called it with this line of code:
response = session.post(logic_app_url, headers=headers, data=json.dumps(payload))Our notebook script loops through the API endpoints, calls the Logic App for each one, and writes the results directly to a Delta table and this works perfectly fine!!
Hopefully this helps other people within the (near) future. I struggled with this for a very long time.
- Logic app:
Hi Anonymous , nilendraFabric ,
Thank you for your response. I never created a function before, but when trying to deploy the azure function, but my function keeps dissapearing and im not able to create another as my "add function button" is gone...
I do see the app files, and the app service is also working.
ā
I deleted the function and added it again in the portal, but same thing keeps happening. I do have suffiencient rights.
What am i doing wrong?
Hi MartijnCyg,
Since your request is related to Azure. I suggest you to raise it in Azure community forum. So that your issue will be addressed more effectively.
Category: Azure | Microsoft Community Hub
Regards,
Vinay Pabbu