Forum Discussion
How to link SQL server in private network from pipeline in Fabric?
Hello e , Do you have any idea about linking SQL server in private network from pipeline in Fabric?
We have created:
1)SQL server in private network in Azure
2)managed private endpoint in Fabric to link the private SQL server
3)Approved the private access under the private SQL server
As a test, we tried to connect the private SQL server in notebook, it works.
But when we tried to connect the private SQL server in pipeline in Fabric, it raise the following error: Connection was denied since Deny Public Network Access is set to Yes.
Do you have any suggestion about this? Very appreciate if you could help on it.
Thanks.
11 Replies
Hi, Winnie20242024
Depending on the information you report as an error, the cause could be Azure SQL Database is set to deny public network access. This requires to use managed virtual network and create private endpoint to access.
Recommendation:
-
If you insist on disabling public network access, use managed virtual network integration runtime and create private endpoint. For more information, see Azure Data Factory managed virtual network.
-
Otherwise, enable public network access by setting Public network access option to Selected networks on Azure SQL Database Networking setting page.
Best Regards,
Community Support Team _Charlotte
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
-
We have created private endpoint. But it works for notebook in Fabric. But it does not work for datapipeline in Fabric.
Houston-hoAdvocate I
I believe you are using different authentication method to your SQL server. Are they the same in both notelook and pipeline linked service?
In Notebook, we are using jdbc with user name and password to connect SQL server
In Pipeline, we are trying to use the "Basic" auth kind with username and passsword like below:
Any suggestion? Thanks
frithjof_vCommunity Champion
Per my understanding, managed private endpoint is for Spark (Fabric notebook) and Data Gateway is for fabric data factory.
Have you considered the Data Gateway option?
https://learn.microsoft.com/en-us/fabric/security/white-paper-landing-page
I don't have experience with it myself.
- Houston-ho
They are 2 different features.
Data gateway is for on-premises data source. Example if you have a virtual machine on Azure, and you have SQL server inside, then you need date gateway to connect to that machine and that SQL database, same as Power BI, Data Factory linked service and Fabric.
For the current case, Azure SQL, probably not Data Gateway.
- frithjof_v
Did you check out the VNET Gateway?
https://learn.microsoft.com/en-us/data-integration/vnet/overview
https://learn.microsoft.com/en-us/data-integration/vnet/use-data-gateways-sources-power-bi
It mentions Azure SQL. However I read someone mention that Data pipeline cannot use VNET Gateway, only On Prem Gateway.
I think the managed private endpoint is only for Spark so I don't think it will work with Data pipeline.
https://learn.microsoft.com/en-us/fabric/security/security-managed-private-endpoints-overview
It's my brief impression.
Edit:
Azure SQL database has a green checkmark for on-premises data gateway on this page: https://learn.microsoft.com/en-us/fabric/data-factory/pipeline-support#a
I'm curious to hear if you find a solution to your case, or if this is not possible to solve with fabric data pipeline.
