Reply
bcdobbs
Community Champion
Community Champion

mssparkutils inside python package

Hi,

 

I've started to build a set of helper functions for my fabric notebooks to do things like refreshes and getting attachments from emails. Mostly just wrappers round msal and requests.

 

Code runs fine direct in a notebook. I've then wrapped it in a wheel file and imported which again works. However when executing the imported code, the notebook says mssparkutils isn't recognised. Any ideas hiw I reference it correctly?


Code is in: 

https://github.com/ArchwayTrust/Fabric-PythonHelper

 

thanks 

Ben



Ben Dobbs

LinkedIn | Twitter | Blog

Did I answer your question? Mark my post as a solution! This will help others on the forum!
Appreciate your Kudos!!
1 ACCEPTED SOLUTION

Hi @bcdobbs 
Thanks for explaining the issue.
Please install dummy notebookutils in local environment. This will solve your issue.

pip install dummy-notebookutils

 

For more information please refer to this linkdummy-notebookutils 
Hope this helps. Please let me know if you have any further questions.

View solution in original post

5 REPLIES 5
bcdobbs
Community Champion
Community Champion

I've gone back and built a very simple example.

 

Inside a notebook I can run:

def run_me_local():
    help(mssparkutils)

run_me_local()

and it happily returns the help description for mssparkutils.

 

If I wrap the same thing in a python wheel package and import it into an environment:

bcdobbs_0-1701426537471.png

My question is how do I build a wheel file that "knows" about mssparkutils? In my local environment mssparkutils doesn't exist which I suspect is problem.

 

Full code used to produce the wheel:

my_code.py:

def run_me():
    help(mssparkutils)

setup.py (guessing I need mssparkutils in the install_requires but it then says it doesn't exist:

from setuptools import setup, find_packages

setup(
    name='wheel_test',
    version='0.1',
    packages=find_packages(),
    install_requires=[

    ],
    author='Ben Dobbs',
    author_email='email@email.com',
    description='Wheel Testing',
    long_description=open('README.md').read(),
    long_description_content_type='text/markdown',
)

  



Ben Dobbs

LinkedIn | Twitter | Blog

Did I answer your question? Mark my post as a solution! This will help others on the forum!
Appreciate your Kudos!!

Hi @bcdobbs 
Thanks for explaining the issue.
Please install dummy notebookutils in local environment. This will solve your issue.

pip install dummy-notebookutils

 

For more information please refer to this linkdummy-notebookutils 
Hope this helps. Please let me know if you have any further questions.

Thanks I literally just found it works ok if I add

from notebookutils import mssparkutils

The dummy-notebookutils stops it complaining locally though so thank you for that. 



Ben Dobbs

LinkedIn | Twitter | Blog

Did I answer your question? Mark my post as a solution! This will help others on the forum!
Appreciate your Kudos!!

Hi @bcdobbs 
Glad that your query got resolved. Please continue using Fabric Community for any help regarding your queries.

v-nikhilan-msft
Community Support
Community Support

Hi @bcdobbs 
Thanks for using Fabric Community.
Have you run the code in Fabric Notebook?  Did you install some other whl which includes notebookutils package? 
How did you execute the imported code? Can you please provide me some screenshots along with the error message?
This would help me in understanding the issue better.
Thanks.

avatar user

Helpful resources

Announcements
Feb2025 Sticker Challenge

Join our Community Sticker Challenge 2025

If you love stickers, then you will definitely want to check out our Community Sticker Challenge!

JanFabricDE_carousel

Fabric Monthly Update - January 2025

Explore the power of Python Notebooks in Fabric!

JanFabricDW_carousel

Fabric Monthly Update - January 2025

Unlock the latest Fabric Data Warehouse upgrades!

Top Solution Authors (Last Month)
Top Kudoed Authors (Last Month)