topic Is the Lakehouse Connection in Notebooks Supposed to Update when you select a different Lakehouse? in Data Engineering

Is the Lakehouse Connection in Notebooks Supposed to Update when you select a different Lakehouse?

tmjones2 — Fri, 28 Mar 2025 10:59:24 GMT

Is this intended? I would assume if you pick a different lakehouse, it would automatically update so that anything you run in the notebook is on that lakehouse.

I also ran a little experiment, the only time it ever updates the database you're actually hitting is when you change the default lakehouse (or if you do a spark.sql(f"USE {some_lakehouse}")). Has it always worked this way? Seems like I've spent way too much time in the notebooks to have never noticed this...

Thanks.

Re: Is the Lakehouse Connection in Notebooks Supposed to Update when you select a different Lakehous

v-veshwara-msft — Mon, 31 Mar 2025 09:46:02 GMT

Hi @tmjones2 ,

Yes, this is actually the expected behavior in Fabric notebooks. When you select a different Lakehouse in the UI, it doesn’t automatically update the active connection in the notebook. Instead, the notebook sticks to the Lakehouse it was originally connected to unless you explicitly change it.

The likely reason behind it is to prevent disruptions if you're running a long session, switching the Lakehouse in the UI won’t suddenly reroute your queries and cause unintended issues. The notebook kernel maintains its own session state, so even though the UI makes it seem like the Lakehouse should change, the actual connection remains the same.

To make sure you're querying the right Lakehouse, you can:

Set the default Lakehouse – This ensures the correct one is used when you restart the session.
Explicitly switch Lakehouses in SQL – As you mentioned, running:
spark.sql(f"USE {some_lakehouse}")

will point your session to the correct Lakehouse.

It’s easy to overlook this since the UI makes it seem like selecting a new Lakehouse should apply everywhere, but the notebook maintains its own connection. A best practice is to always set the Lakehouse explicitly in your notebook if you're switching.

For more details, check out these resources:

Connect lakehouses and notebooks: https://learn.microsoft.com/en-us/fabric/data-engineering/how-to-use-notebook#connect-lakehouses-and-notebooks
Programmatically Removing & Updating Default Lakehouse in a Notebook: https://fabric.guru/programmatically-removing-updating-default-lakehouse-of-a-fabric-notebook
Update attached Lakehouse using code: https://community.fabric.microsoft.com/t5/Data-Engineering/Update-Notebook-attached-lakehouse-using-code/m-p/4379350

Hope this helps! Let us know if you have any other questions.

If this post helps, then please consider "Accept it as the solution" to help the other members find it more quickly and a kudos would be appreciated.

Best Regards,
Vinay.

Re: Is the Lakehouse Connection in Notebooks Supposed to Update when you select a different Lakehous

v-veshwara-msft — Mon, 21 Apr 2025 11:11:49 GMT

Hi @tmjones2 ,

Following up to see if your query has been resolved. If so, please consider marking the helpful response as the Accepted Solution to assist others with similar issues. If you still need assistance, feel free to reach out.

Thank you!

Re: Is the Lakehouse Connection in Notebooks Supposed to Update when you select a different Lakehous

v-veshwara-msft — Wed, 30 Apr 2025 09:22:44 GMT

Hi @tmjones2 ,

Just checking in to see if you query is resolved and if any responses were helpful. If so, kindly consider marking the helpful reply as 'Accepted Solution' to help others with similar queries.

Otherwise, feel free to reach out for further assistance.

Thank you.

Re: Is the Lakehouse Connection in Notebooks Supposed to Update when you select a different Lakehous

v-veshwara-msft — Mon, 05 May 2025 12:08:14 GMT

Hi @tmjones2 ,

We’re following up once more regarding your query. If it has been resolved, please mark the helpful reply as the Accepted Solution to assist others facing similar challenges.

If you still need assistance, please let us know.
Thank you.