topic Re: How to pass parameters to notebook to be used in %%configure cell in Data Engineering

How to pass parameters to notebook to be used in %%configure cell

amaaiia — Tue, 09 Apr 2024 08:39:34 GMT

I want to configure the default lakehouse of my notebook programatically, I want the default lakehouse to be passed through parameters.

I've found a way to configure the default lakehouse with %%configure script:

It works if I directly write the lakehouse name, id and workspace id in the same cell, and I run this cell the first one before the rest of the cells. But I want these three values to be passed by parameter, so I need to run parameters cell before %%configure cell, and if I do that, I get and error:

MagicUsageError: The current running Livy session must be restarted for the config changes to take effect. Specify the argument "-f" to force restarting Livy session. Any variables stored in memory will be cleared.

So, how can I pass the parameters to %%configure cell if I have to run %%configure cell before any other to work?

Re: How to pass parameters to notebook to be used in %%configure cell

Expiscornovus — Tue, 09 Apr 2024 14:35:39 GMT

Hi @amaaiia,

You can use Parameterized session configuration for this:

https://learn.microsoft.com/en-us/fabric/data-engineering/author-execute-notebook#parameterized-session-configuration-from-a-pipeline

Below is an example code snippet

%%configure { "defaultLakehouse": { "name": { "parameterName": "defaultLakehouseName", "defaultValue": "FourthLakehouse" }, "id": { "parameterName": "defaultLakehouseId", "defaultValue": "773faa37-826f-4f9b-830f-e2a7a23e3903" } } }

Re: How to pass parameters to notebook to be used in %%configure cell

amaaiia — Tue, 09 Apr 2024 15:08:02 GMT

It works!!

Re: How to pass parameters to notebook to be used in %%configure cell

Ben1489 — Mon, 29 Jul 2024 17:02:31 GMT

Is there a way to supply additional parameteres for use later on in the notebook?

Re: How to pass parameters to notebook to be used in %%configure cell

Toadie — Fri, 30 Jan 2026 14:53:53 GMT

Hi,

This just resolved a real issue for me. I did have to add -f to the configure code line:

%%configure -f

It even works when the notebook already has a default Lakehouse mapped.

Thanks.