Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Get certified in Microsoft Fabric—for free! For a limited time, get a free DP-600 exam voucher to use by the end of 2024. Register now

Reply
keataunooi
Regular Visitor

How to set default Lakehouse in the notebook programmatically?

Hi All,

 

Here are my workspace setup:

 

WorkspaceFabric's ArtifactsGit branch folder
Fabric-Sandbox

notebook: landingtoBronze

lakehouse: Bronze

feature/bronze123

Fabric-Dev

notebook: landingtoBronze

lakehouse: Bronze

Dev

 

Problem:

 

Each time i updated the notebooks code to the Fabric-Dev workspace , i need to attach bronze lakehouse to "landingtoBronze" notebooks manually in the workspace so that it point to the right bronze lakehouse.  

Please note that each workspace has it own Bronze Lakehouse.

 

For example, I was working in the "landingtoBronze" notebook in my feature branch in the Fabric-sandbox workspace. during the notebook development, I attached the bronze lakehouse of the workspace as default lakehouse to the notebook.

once i had finished my notebook development, i created the pull request and merge the code from feature branch into dev branch.

 

while getting the code updated in the Fabric-Dev workspace, I can see the default bronze database is actually referring to the Fabric Sandbox workspace. 

 

Is it possible to attach a default lakehouse in the notebook programmactically?

 

Looking forward to hearing for any suggestion. it could be something that i am doing wrongly.

 

keataunooi_1-1709176759934.png

 

 Thanks.

1 ACCEPTED SOLUTION
v-nikhilan-msft
Community Support
Community Support

Hi @keataunooi 
Thanks for using Fabric Community.
To programmatically attach a lakehouse for a session level, you can use this below code in your notebook:

# Welcome to your new notebook
# Type here in the cell editor to add code!
%%configure
{
    "defaultLakehouse": {  # This overwrites the default lakehouse for current session
        "name": "your-lakehouse-name",
        #"id": "<(optional) lakehouse-id>",
        #"workspaceId": "<(optional) workspace-id-that-contains-the-lakehouse>" # Add workspace ID if it's from another workspace
    }
}


Hope this helps. Please let me know if you have any further questions.

View solution in original post

9 REPLIES 9
gori137
New Member

Thanks for an excelent question. I can't use the %%configure command.
The error message is :
UsageError: Line magic function '%%configure' not found.

Same for me. Is there missing a library? Isn't this magic part of sparkmagic? When use %pip install to install sparkmagic, an error is occurring "ERROR: Could not build wheels for gssapi, krb5, which is required to install pyproject.toml-based projects"...

felipe_regis
New Member

For some people it worked but It didn't work for me. I got "UsageError: Line magic function `%%configure` not found."

Why?

Thanks

 

 

v-nikhilan-msft
Community Support
Community Support

Hi @keataunooi 
Thanks for using Fabric Community.
To programmatically attach a lakehouse for a session level, you can use this below code in your notebook:

# Welcome to your new notebook
# Type here in the cell editor to add code!
%%configure
{
    "defaultLakehouse": {  # This overwrites the default lakehouse for current session
        "name": "your-lakehouse-name",
        #"id": "<(optional) lakehouse-id>",
        #"workspaceId": "<(optional) workspace-id-that-contains-the-lakehouse>" # Add workspace ID if it's from another workspace
    }
}


Hope this helps. Please let me know if you have any further questions.

But is that I have to have this cell at first in the notebook?

Hi @v-nikhilan-msft 

If I have a Lakehouse with the same name both in Dev and in Prod workspaces, this code will attach the corresponding Lakehouse , if I do not specify Workspace ID ?

Even I have the same question. Does it attach lakehouse from the current workspace in case workspaceid is not mentioned?

And also does the notebook use other lakehouses of current workspace in SparkSQL ?

Thanks. just tested the code you provided. it works. 

I also figure out the default lakehouse of the notebook can be overriden by the pipeline deployment rules 

Create deployment rules for Fabric's Application lifecycle management (ALM) - Microsoft Fabric | Mic...

 

Thanks again!

 

Hi @keataunooi 
Glad that your query got resolved. Please continue using Fabric Community for any help regarding your queries.

Helpful resources

Announcements
November Carousel

Fabric Community Update - November 2024

Find out what's new and trending in the Fabric Community.

Live Sessions with Fabric DB

Be one of the first to start using Fabric Databases

Starting December 3, join live sessions with database experts and the Fabric product team to learn just how easy it is to get started.

November Update

Fabric Monthly Update - November 2024

Check out the November 2024 Fabric update to learn about new features.

Las Vegas 2025

Join us at the Microsoft Fabric Community Conference

March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount! Early Bird pricing ends December 9th.