Fabric - cant import AzureOpenAI

[Anonymous]

when you try to run the sample code in a fabric pyspark(python) notebook you might instantly hit the following issue

ImportError: cannot import name 'AzureOpenAI' from 'openai' (/home/trusted-service-user/cluster-env/trident_env/lib/python3.10/site-packages/openai/__init__.py)

This is because the version 0.27.8 is the default in the fabric environment. To force a newer verison make sure to install it either inline or via an environment config

here is the inline code:

%pip install openai==1.12.0

[Anonymous · Accepted solution]

Hi. I must have chose the wrong type of post. I was not Posting a question but a solution.

I followed the instructions from the github repo and ran into Thais issue. That's why I thought I'd post the solution for others to benefit.

[edchuy]

You might want to take a look at this:

Access Azure OpenAI for Hack Together, for Free! 

Let us know if you managed to make it work.

[arminokic]

Hi! Do you know how to use this openai endpoint with Python? I am not sure how to authenticate correctly.

[Anonymous]

The github page has all you need. the sample uses environment variables. not that simple in fabric. so if you want to get started fast, try putting the parameters into the code directly.

instructions on getting started and getting your API Key here:

Hack-Together-Fabric-AI/AI_access.md at main · microsoft/Hack-Together-Fabric-AI · GitHub 

sample code to talk to the api here

azure-openai-service-proxy/examples/python/openai_sdk_1.x/azure_openai_chat.py at main · microsoft/a...

and to make your life easier: here a snippet that worked for me. just replace the api key

%pip install openai==1.12.0

import openai

from openai import AzureOpenAI

client = AzureOpenAI(

azure_endpoint="https://polite-ground-030dc3103.4.azurestaticapps.net/api/v1",

api_key="your-api-key-from-the-step-previous",

api_version="2023-09-01-preview",

)

MESSAGES = [

{"role": "system", "content": """you are a funny bot"""},

{"role": "user", "content": "tell me a joke about pumpkins"},

{"role": "assistant","content": "Why do pumpkins sit on people's porches? They have no hands to knock on the door!"},

]

MESSAGES.append({"role": "user", "content": "tell me a joke about frogs"})

completion = client.chat.completions.create(model="gpt-35-turbo", messages=MESSAGES,temperature=0.9)

print(completion.choices[0].message.content)

[arminokic]

Thanks a lot. This was helpful.

[Anonymous · Accepted solution]

Hi. I must have chose the wrong type of post. I was not Posting a question but a solution.

I followed the instructions from the github repo and ran into Thais issue. That's why I thought I'd post the solution for others to benefit.

[Anonymous · Accepted solution]

here is the inline code needed at the top of your script

%pip install openai==1.12.0

[edchuy]

OK. That's good to know.

[Anonymous]

FYI. If you plan to run a notebook on a schedule or via Rest-API, then you'll have issues as %pip magic is disabled there. Need to create a custom environment with the correct openai dll pre-loaded and use that instead. Makes the startup of the notebook much slower though. instead of 5-10s for getting a running starterpool it will take 1-2 minutes.