Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Get inspired! Check out the entries from the Power BI DataViz World Championships preliminary rounds and give kudos to your favorites. View the vizzies.

Reply
Anonymous
Not applicable

Integrate Large Language Model (LLM) with Power BI

Hello All,

 

Is any one knows how to integrate Large Language model with Power BI. If yes please share the reference article. So that we can utilize natural language quries.

 

Thanks in advance!

7 REPLIES 7
PavanLalwani
Resolver II
Resolver II

Integrating a Large Language Model (LLM) with Power BI can significantly enhance data exploration and analytics by enabling natural language queries, insights generation, and predictive analytics. Here are some methods to achieve this integration:

1. **Using Power BI Copilot**: Power BI’s Copilot, available through Microsoft Fabric, allows you to add LLM-based natural language prompts directly into reports. This feature enables users to type questions or commands in natural language, and the LLM interprets these inputs to generate visualizations or summaries. The Copilot Narrative visual, for example, allows for automatic narrative descriptions of data visuals, dynamically updating as filters or data views change within the report. You need Power BI Premium or Fabric capacity to utilize this feature, and it connects to models in Azure OpenAI, such as GPT-3 or GPT-4, for processing the natural language inputs.

2. **Direct Azure Machine Learning Integration**: Alternatively, you can deploy an LLM model, such as GPT-2 or GPT-3, on Azure Machine Learning, and connect it with Power BI through Power Automate and Power Apps. This setup involves creating a real-time endpoint for the model in Azure, which can process data queries or provide insights on-demand as users interact with Power BI visuals. This approach requires setup in both Power Automate (for API calls) and Power Apps (to handle input/output), and can be customized for specific types of data analysis tasks, such as summarization or sentiment analysis.

3. **Fine-tuning LLMs for Specific Data Needs**: If your business requires domain-specific insights, consider fine-tuning an LLM to your dataset. Azure provides resources for fine-tuning, allowing you to train the model with data that is most relevant to your industry or analytical needs. This fine-tuned model can then offer more accurate predictive analytics, trend analysis, and data descriptions, especially useful for industries with complex datasets, like healthcare or finance.

Each of these methods leverages the Azure OpenAI service for model hosting, making LLMs accessible to Power BI in ways that streamline data interpretation and reporting processes without requiring extensive SQL or DAX knowledge. For further guidance, Microsoft’s documentation and community forums offer step-by-step resources for deploying these models in Power BI environments.

For more details, check resources from Microsoft and Dataproducts.io for practical steps on setting up and fine-tuning LLMs with Power BI.

Yes, but where is the correct video link?

lbendlin
Super User
Super User

Check out chatPowerBI!

 

Our product integrates large language models (LLMs) directly into Power BI, allowing you to query your data easily and efficiently. It supports multiple languages, not just English. We also support various models from OpenAI and Anthropic, and you can even bring your own LLM deployment (BYO LLM).


Watch our video demo

chatPowerBI_0-1726587697270.png

 

Hi @chatPowerBI , the demo video location is invalid, can you post it once again? many thanks!!

Hey @prosar , just updated the video link. Thanks! 

thanks a lot. got it!

Helpful resources

Announcements
Las Vegas 2025

Join us at the Microsoft Fabric Community Conference

March 31 - April 2, 2025, in Las Vegas, Nevada. Use code FABINSIDER for a $400 discount!

FebPBI_Carousel

Power BI Monthly Update - February 2025

Check out the February 2025 Power BI update to learn about new features.

March2025 Carousel

Fabric Community Update - March 2025

Find out what's new and trending in the Fabric community.