topic Re: Fabric - cant import AzureOpenAI in Hack Together

Fabric - cant import AzureOpenAI

Anonymous — Thu, 15 Feb 2024 20:08:54 GMT

when you try to run the sample code in a fabric pyspark(python) notebook you might instantly hit the following issue

ImportError: cannot import name 'AzureOpenAI' from 'openai' (/home/trusted-service-user/cluster-env/trident_env/lib/python3.10/site-packages/openai/__init__.py)

This is because the version 0.27.8 is the default in the fabric environment. To force a newer verison make sure to install it either inline or via an environment config

here is the inline code:

%pip install openai==1.12.0

Re: Fabric - cant import AzureOpenAI

edchuy — Thu, 15 Feb 2024 23:30:05 GMT

You might want to take a look at this:

Access Azure OpenAI for Hack Together, for Free!

Let us know if you managed to make it work.

Re: Fabric - cant import AzureOpenAI

Anonymous — Fri, 16 Feb 2024 06:58:28 GMT

Hi. I must have chose the wrong type of post. I was not Posting a question but a solution.

I followed the instructions from the github repo and ran into Thais issue. That's why I thought I'd post the solution for others to benefit.

Re: Fabric - cant import AzureOpenAI

Anonymous — Fri, 16 Feb 2024 06:59:42 GMT

here is the inline code needed at the top of your script

%pip install openai==1.12.0

Re: Fabric - cant import AzureOpenAI

edchuy — Fri, 16 Feb 2024 14:57:25 GMT

OK. That's good to know.

Re: Fabric - cant import AzureOpenAI

Anonymous — Fri, 16 Feb 2024 15:11:34 GMT

FYI. If you plan to run a notebook on a schedule or via Rest-API, then you'll have issues as %pip magic is disabled there. Need to create a custom environment with the correct openai dll pre-loaded and use that instead. Makes the startup of the notebook much slower though. instead of 5-10s for getting a running starterpool it will take 1-2 minutes.

Re: Fabric - cant import AzureOpenAI

arminokic — Tue, 20 Feb 2024 10:19:14 GMT

Hi! Do you know how to use this openai endpoint with Python? I am not sure how to authenticate correctly.

Re: Fabric - cant import AzureOpenAI

Anonymous — Tue, 20 Feb 2024 11:18:49 GMT

The github page has all you need. the sample uses environment variables. not that simple in fabric. so if you want to get started fast, try putting the parameters into the code directly.

instructions on getting started and getting your API Key here:

Hack-Together-Fabric-AI/AI_access.md at main · microsoft/Hack-Together-Fabric-AI · GitHub

sample code to talk to the api here

azure-openai-service-proxy/examples/python/openai_sdk_1.x/azure_openai_chat.py at main · microsoft/azure-openai-service-proxy · GitHub

and to make your life easier: here a snippet that worked for me. just replace the api key

%pip install openai==1.12.0

import openai

from openai import AzureOpenAI

client = AzureOpenAI(

azure_endpoint="https://polite-ground-030dc3103.4.azurestaticapps.net/api/v1",

api_key="your-api-key-from-the-step-previous",

api_version="2023-09-01-preview",

)

MESSAGES = [

{"role": "system", "content": """you are a funny bot"""},

{"role": "user", "content": "tell me a joke about pumpkins"},

{"role": "assistant","content": "Why do pumpkins sit on people's porches? They have no hands to knock on the door!"},

]

MESSAGES.append({"role": "user", "content": "tell me a joke about frogs"})

completion = client.chat.completions.create(model="gpt-35-turbo", messages=MESSAGES,temperature=0.9)

print(completion.choices[0].message.content)

Re: Fabric - cant import AzureOpenAI

arminokic — Tue, 20 Feb 2024 11:21:39 GMT

Thanks a lot. This was helpful.