Forum Discussion
Fabric Mirrored Azure Databricks Catalog
Hey,
I want to connect Fabric to Databricks behind a firewall and vnet.
i get 2 different issues.
- When I create a new connection, I always get Invalid credentials (SP or organizational login). I can even log in using Power BI, which can access Databricks. After getting that error, the connection is created.
- If I try to connect from one of these created connections, I get Unauthorized network access to workspace error.
Steps:
- verified SP is working fine and added to Databricks workspace and has access to the catalog and its storage account.
- allowed catalog external access as well.
- Opened firewall rules to accept traffic from Fabric IPs to Databricks subnet.
- In fabric, I created an Outbound networking endpoint to Databricks and storage accounts and approved it.
What else needs to be done to make it work?
Thanks
Hi nerminyehia
Thank you for your question on the Microsoft Fabric Community Forum.
Fabric Mirroring for Azure Databricks currently supports only public endpoint configurations. Private endpoints, VNets, or firewall-only setups are not supported, which leads to the “Unauthorized network access” error. Additionally, the service principal used for authentication must belong to the same Microsoft Entra ID tenant as Fabric; otherwise, you will encounter an “Invalid credentials” error. To enable successful mirroring, ensure that both the Databricks workspace and the associated storage accounts allow public endpoint access, implement IP allowlisting for Microsoft Fabric’s documented IP ranges, and use a service principal from the same tenant with appropriate Unity Catalog and storage permissions. If your architecture requires private networking, mirroring will not be feasible. In such cases, we recommend using Fabric Data Factory pipelines with Managed VNet and Fast Copy, which provide secure and scalable data movement while adhering to networking restrictions.
For more information refer to the official document below:Microsoft Fabric Mirrored Databases From Azure Databricks Tutorial
Microsoft Fabric Mirrored Databases From Azure Databricks Security - Microsoft Fabric
Limitations in Microsoft Fabric Mirrored Databases From Azure Databricks - Microsoft Fabric
I hope this information is helpful. . If you have any further questions, please let us know. we can assist you further.Regards,
Microsoft Fabric Community Support Team.
4 Replies
v-karpurapudCommunity Support
Hi nerminyehia
Thank you for your question on the Microsoft Fabric Community Forum.
Fabric Mirroring for Azure Databricks currently supports only public endpoint configurations. Private endpoints, VNets, or firewall-only setups are not supported, which leads to the “Unauthorized network access” error. Additionally, the service principal used for authentication must belong to the same Microsoft Entra ID tenant as Fabric; otherwise, you will encounter an “Invalid credentials” error. To enable successful mirroring, ensure that both the Databricks workspace and the associated storage accounts allow public endpoint access, implement IP allowlisting for Microsoft Fabric’s documented IP ranges, and use a service principal from the same tenant with appropriate Unity Catalog and storage permissions. If your architecture requires private networking, mirroring will not be feasible. In such cases, we recommend using Fabric Data Factory pipelines with Managed VNet and Fast Copy, which provide secure and scalable data movement while adhering to networking restrictions.
For more information refer to the official document below:Microsoft Fabric Mirrored Databases From Azure Databricks Tutorial
Microsoft Fabric Mirrored Databases From Azure Databricks Security - Microsoft Fabric
Limitations in Microsoft Fabric Mirrored Databases From Azure Databricks - Microsoft Fabric
I hope this information is helpful. . If you have any further questions, please let us know. we can assist you further.Regards,
Microsoft Fabric Community Support Team.
- v-karpurapud
Hi nerminyehia
I wanted to check if you’ve had a chance to review the information provided. If you have any further questions, please let us know. Has your issue been resolved? If not, please share more details so we can assist you further.
Thank You. - v-karpurapud
Hi nerminyehia
We have not received a response from you regarding the query and were following up to check if you had the opportunity to review the information provided. Please feel free to contact us if you have any further questions.
Thank You.
- v-karpurapud
Hi nerminyehia
Just checking in as we haven't received a response to our previous message. Were you able to review the information above? Let us know if you have any additional questions.
Thank You.