Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Register now to learn Fabric in free live sessions led by the best Microsoft experts. From Apr 16 to May 9, in English and Spanish.

Reply
gregahren
Frequent Visitor

Fabric environment + public library not working

I am trying to create fabric environmet which would contain pydantic==2.5.2 pypi package, so I can make use of the library in the notebook or in my spark jobs:

 

from pydantic import RootModel

 

Note that RootModel is only available in pydantic version 2.5.2

The result is:

gregahren_0-1705493424369.png

If I do %pip list I see that pydantiv v1 is still installed:

gregahren_1-1705493532303.png

 

Here is also screen of how my environment is set up:

gregahren_2-1705493593270.png

 

14 REPLIES 14
HimanshuS-msft
Community Support
Community Support

Hello @gregahren 
Thanks for using the Fabric community.

Are you hitting this error : [Bug]: cannot import name 'RootModel' from 'pydantic' · Issue #1237 · binary-husky/gpt_academic · Gi...
As mentioned in the issue , can you please try 
gradio==3.48.0

and see if that fixes the problem . 
Thanks 
Himanshu 

 







Thanks
HImanshu

Hi,

 

thank you for the response.

Actually I dont want to install gradio into my environment since that is not neccessary, also that introduces a lot of uneccessary packages to be install into environment as a direct dependencies of gradio package.

 

I can do %pip install pydantic==2.5.2 directly in notebook and that installs library as expected. But what if I want to use it in my spark job where magic commands are not available?

 

Thanks

Hi @gregahren ,

In current design, for PySpark, beside the main execution file, user can also upload other python module as .py file into the SJD as additional reference. But .whl package is not supported yet. 

 

Appreciate if you could share the feedback on our feedback channel. Which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.

 

Hope this helps. Please let me know if you have any further queries.

Hi @v-gchenna-msft ,

 

I appreciate your prompt response.

While I understand the suggestion to share this in the feedback channel and submit it as an idea, I believe the issue at hand is more aligned with a bug rather than a feature.

Allow me to reiterate: I am attempting to install version 2.5.3 of the Pydantic library from PyPI, as illustrated in the provided image:

gregahren_0-1706168418759.png

However, when I utilize this created environment in a notebook or Spark job, the desired package is unavailable. Instead, I observe the presence of Pydantic version 1, contrary to my explicit specification of version 2.5.3 in the environment.

I hope this clarifies the situation. Your assistance in resolving this matter would be greatly appreciated.

Thank you.

Hi @gregahren ,

When I tried to repro your scenario i didn't face any issue like you mentioned.

Sample Environment -

vgchennamsft_0-1706196053764.png

Sample Notebook -

vgchennamsft_1-1706196115030.png

 

vgchennamsft_2-1706196132842.png

If you are still the facing, can you please try to recreate new environment and try again.

Hope this is helpful. Please let me know incase of further queries.

I have the same issue. Has there been found a solution?

Hi @iaaaph 

 

there is still an active ticket opened and PG team is still in the process to find the root cause of the issue.

 

Will let you know after I recieve more info.

thank you, i would appreciate that very much.

If you need a quick and dirty solution to still be able to install pydantic and use notebook in pipelines or similar we found a workaround which is not pretty but it works for us for now:

import os
from notebookutils import mssparkutils

os.system("pip install pydantic==2.6.0")
mssparkutils.session.restartPython()

Still we expect this to not be neccessary if this is specified already in environment.

my issue is with numpy = 1.25 and tensorflow = 2.11 instead of 1.23.5 and 2.12 respectively. But I will check if I can use your solution until they fix it. Thank you.

Im sorry but still I am facing the same issue:

gregahren_2-1706261949472.png

 

gregahren_3-1706261959019.png

 

I also have a ticket opened with support so I will update you if they figure it out.

Hi @gregahren ,

Thanks for the reply.
Can you please provide the support ticket number as it would help us to track for more information?

Sure here it is: #2401220050004122

I will retry it again and let you know. Thanks.

Helpful resources

Announcements
Microsoft Fabric Learn Together

Microsoft Fabric Learn Together

Covering the world! 9:00-10:30 AM Sydney, 4:00-5:30 PM CET (Paris/Berlin), 7:00-8:30 PM Mexico City

March 2024  FBC Gallery Image

Fabric Monthly Update - March 2024

Check out the March 2024 Fabric update to learn about new features.

April Fabric Community Update

Fabric Community Update - April 2024

Find out what's new and trending in the Fabric Community.