topic Re: How can I connect to a SQL Mirror Database? in Data Engineering

How can I connect to a SQL Mirror Database?

abhidotnet — Tue, 15 Jul 2025 14:58:15 GMT

I’m working in a workspace in Microsoft Fabric where I’ve set up a notebook intended to connect to a SQL Mirror Database hosted in the same Fabric environment. However, when I try using the “Connect to Source” option in the notebook, the database doesn’t appear in the list—only Lakehouses from other workspaces show up.

Is there a recommended way to connect a Spark notebook to a SQL Mirror Database in Fabric?
Am I missing a configuration step, or is there a specific connection string or method I should use manually?

Appreciate any guidance or examples from those who’ve set this up successfully!

Re: How can I connect to a SQL Mirror Database?

ToddChitt — Tue, 15 Jul 2025 20:37:16 GMT

This may not be a real solution to your issue, but WHY do you want to connect a Notebook to a Mirrored SQL database? Typically, you use Notebooks to collect and process non-tabular data sources (Excel, JSON, XML, etc.) and from there dump it into tabular destinations (read: tables).

If data is ALREADY in tables in the mirrored database, why not use T-SQL to access and process it?

Re: How can I connect to a SQL Mirror Database?

v-priyankata — Thu, 17 Jul 2025 08:04:24 GMT

Hi @abhidotnet

Thank you for reaching out to the Microsoft Fabric Forum Community.
@ToddChitt Thanks for your valuable inputs.
It's also a good idea to consider suggestions from the user, we can try that. adding another point below.

The connect to data option in fabric notebooks only shows Lakehouse & KQL databases, we are not able see SQL Mirrored Databases listed there, even if your in the same workspace. To work around this, we can create a Lakehouse and adding a One Lake shortcut that points to the mirrored SQL database. please refer below document.
Explore Data in Your Mirrored Database With Notebooks - Microsoft Fabric | Microsoft Learn

Please feel free to reach out here if you need further assistance.
Thanks.

Re: How can I connect to a SQL Mirror Database?

BhaveshPatel — Fri, 18 Jul 2025 09:44:04 GMT

Hi @abhidotnet

Rather than writing programming code like python or scala in notebook, you should use UI/ UX in Dataflow Gen 2 and use Mirrored SQL Database. ( Click, Click and Click and you are done..)

Re: How can I connect to a SQL Mirror Database?

Element115 — Fri, 18 Jul 2025 20:59:57 GMT

because you can do things more easily and in a saner way in Python than with the antedeluvian 4GL language that SQL is. That would be my reason #1.

#2 you got a bunch of libs in Python to do data science and data engineering that do not exist in the SQL world.

and on and on it goes.

Re: How can I connect to a SQL Mirror Database?

Element115 — Fri, 18 Jul 2025 21:01:05 GMT

careful though with DFg2 as it is a lot more expensive in terms of CUs than doing the same with either SQL script or PySpark Notebook in a pipeline.

Re: How can I connect to a SQL Mirror Database?

v-priyankata — Mon, 21 Jul 2025 15:34:53 GMT

Hi @abhidotnet

I hope the information provided was helpful. If you still have questions, please don't hesitate to reach out to the community.

Re: How can I connect to a SQL Mirror Database?

v-priyankata — Thu, 24 Jul 2025 16:33:00 GMT

Hi @abhidotnet

I wanted to check if you had the opportunity to review the information provided by all. Please feel free to contact us if you have any further questions.

Re: How can I connect to a SQL Mirror Database?

v-priyankata — Mon, 28 Jul 2025 09:38:12 GMT

Hi @abhidotnet

Hope everything’s going smoothly on your end. We haven’t heard back from you, so I wanted to check if the issue got sorted. if you have any other issues please reach community.

Re: How can I connect to a SQL Mirror Database?

abhidotnet — Wed, 13 Aug 2025 20:08:49 GMT

I was on vacation. I am going to explore this option of creating a lakehouse and a shortcut.

Re: How can I connect to a SQL Mirror Database?

abhidotnet — Wed, 13 Aug 2025 20:14:10 GMT

I require to create a report, dump it in a formatted excel file and send that file over to Azure Blob Storage. I understand there are a number of ways to skin this cat, but there are existing libraries in python that do this pretty easily. I want to leverage the code we already have and use it.

Re: How can I connect to a SQL Mirror Database?

abhidotnet — Wed, 13 Aug 2025 20:15:50 GMT

The information was helpful. There is one caveat: the shortcut to the mirror does not list the views created in the mirror. I can probably work around the views, but I also have a separate request that involves firing a stored procedure.

Re: How can I connect to a SQL Mirror Database?

apturlov — Thu, 14 Aug 2025 01:13:58 GMT

@abhidotnet If you need to use a notebook with your mirrored SQL database there is a way. I cannot tell you if it's a recommended way, but it works.

First, you need a Lakehouse that you will use with your notebook. In that Lakehouse you create a shortcut to your mirrored SQL database and choose your mirror from Internal sources/OneLake.

When your shortcut is created it will appear under Files/[Shortcut name] in the Lakehouse and you would see all tables you picked for your shortcut presented as delta tables.

Now you can go to your notebook and load tables from the shortcut into a dataframe using delta format:

Hope this helps.

Re: How can I connect to a SQL Mirror Database?

abhidotnet — Fri, 12 Sep 2025 20:06:44 GMT

I have solved this issue by creating a User data function. This process is explained here in Microsoft Documentation.

Python programming model for Fabric User data functions (Preview) - Microsoft Fabric | Microsoft Learn

This allows me to make the connection and fetch query results. I am able to get views as well as tables.
As of now, I haven't figured out how to do the stored procedure execution and that is next in line.

my function looks like this -->

import pandas as pd import fabric.functions as fn udf = fn.UserDataFunctions() # Select 'Manage connections' and add a connection to a Fabric SQL Database # Replace the alias "<alias for sql database>" with your connection alias. @udf.connection(argName="sqlDB",alias="MYMIRRORDATABASE") @udf.function() def read_from_sql_db(sqlDB: fn.FabricSqlConnection, query: str)-> pd.DataFrame: ''' Description: Read data from Mirror DATABASE using input query. Args: sqlDB (fn.FabricSqlConnection): Fabric SQL database connection. Returns: DataFrame query result. ''' # Establish a connection to the SQL database connection = sqlDB.connect() df = pd.read_sql(query, connection) print(df.head()) return df;