Forum Discussion
Advocate IHow to load a local LLM into MS Fabric?
Advocate IThanks for your response.
My goal is to implement the following:
1. I have data in OneLake
2. I'd like to use Langchain and OpenSource LLM (Without API Keys and Azure OpenAI or OpenAI) to generate a SQL Prompt and it's table ouput , So how can I achieve this without the use of Azure OpenAI or OpenAI services? Is there another way?
Thanks
Hi supri03
Just for understanding I would like to know why dont you want to use Azure Open AI or Open AI? We have native LLM endpoints in Fabric so you don't need to bring any keys and you can still use Azure OpenAI APIs.
- supri03
We don't have Azure subscription right now. So is there an alternate way to achieve this ?
Hi supri03
Apologies. For now this is the possible way to load a local LLM into MS Fabric.
Use Azure AI services in Fabric - Microsoft Fabric | Microsoft Learn
Overview of Copilot in Fabric and Power BI (preview) - Microsoft Fabric | Microsoft LearnHi supri03
We haven’t heard from you on the last response and was just checking back to see if your query got resolved. Otherwise, will respond back with the more details and we will try to help.
Thanks