topic Re: How to get a variable from one Notebook into another in Pipelines

How to get a variable from one Notebook into another

CrhIT — Wed, 05 Feb 2025 17:17:58 GMT

I'm running a notebook, which output needs to be stored and used in a new notebook. How can this be done?

Let's say in Notebook_1 the code is

import pandas as pd # Create an example pandas DataFrame data = { "ID": [1, 2, 3, 4, 5], "Name": ["Alice", "Bob", "Charlie", "David", "Eve"], "Age": [25, 30, 35, 40, 45], "Salary": [50000, 60000, 70000, 80000, 90000], "Department": ["HR", "IT", "Finance", "Marketing", "Sales"] } df = pd.DataFrame(data)

I want to reference df in a new notebook so I have no need to rewrite the whole code in the new notebook.

Re: How to get a variable from one Notebook into another

nilendraFabric — Wed, 05 Feb 2025 22:29:23 GMT

Hello CrhIT

The `%run` magic command allows you to execute another notebook within the same workspace and access its variables directly.

Notebook1

import pandas as pd

data = {
"ID": [1, 2, 3, 4, 5],
"Name": ["Alice", "Bob", "Charlie", "David", "Eve"],
"Age": [25, 30, 35, 40, 45],
"Salary": [50000, 60000, 70000, 80000, 90000],
"Department": ["HR", "IT", "Finance", "Marketing", "Sales"]
}
df = pd.DataFrame(data)

In Notebook_2, use `%run` to call Notebook_1:
%run Notebook_1
print(df.head())

This method works only if both notebooks are in the same workspace.
• Variables defined in Notebook_1 will be available in Notebook_2

You can use `mssparkutils.notebook.run()`

Hope this is helpful.

please accept the answer and give kudos if this helps

Re: How to get a variable from one Notebook into another

nilendraFabric — Thu, 06 Feb 2025 10:16:49 GMT

CrhIT if this is helpful , please accept the answer as it will help community to find the right information quickly.