Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

The FabCon + SQLCon recap series starts April 14th at 8am Pacific. If you’re tracking where AI is going inside Fabric, this first session is a can't miss. Register now

Reply
Anonymous
Not applicable

Integrate Large Language Model (LLM) with Power BI

Hello All,

 

Is any one knows how to integrate Large Language model with Power BI. If yes please share the reference article. So that we can utilize natural language quries.

 

Thanks in advance!

8 REPLIES 8
querixa
Helper IV
Helper IV

Hi everyone,

We’ve been exploring a similar idea recently: enabling users to interact with Power BI reports using natural language questions.

Instead of relying only on external bots or APIs, we experimented with embedding a conversational interface directly inside the Power BI report using a custom visual connected to an AI layer.

This allows users to ask questions like:

• What is the best-performing product?
• Which region has the highest revenue growth?
• What is the margin trend this quarter?

The visual interprets the question and queries the underlying semantic model so users can explore the data without needing to understand the report structure or DAX.

I recorded a short demo showing how this interaction works inside Power BI:

https://www.linkedin.com/posts/querixa_power-bi-ai-ask-questions-and-get-insights-activity-743840718...

Curious to hear if others here are experimenting with conversational interfaces for Power BI or LLM-driven analytics.

Happy to discuss implementation approaches if anyone is interested.

PavanLalwani
Resolver II
Resolver II

Integrating a Large Language Model (LLM) with Power BI can significantly enhance data exploration and analytics by enabling natural language queries, insights generation, and predictive analytics. Here are some methods to achieve this integration:

1. **Using Power BI Copilot**: Power BI’s Copilot, available through Microsoft Fabric, allows you to add LLM-based natural language prompts directly into reports. This feature enables users to type questions or commands in natural language, and the LLM interprets these inputs to generate visualizations or summaries. The Copilot Narrative visual, for example, allows for automatic narrative descriptions of data visuals, dynamically updating as filters or data views change within the report. You need Power BI Premium or Fabric capacity to utilize this feature, and it connects to models in Azure OpenAI, such as GPT-3 or GPT-4, for processing the natural language inputs.

2. **Direct Azure Machine Learning Integration**: Alternatively, you can deploy an LLM model, such as GPT-2 or GPT-3, on Azure Machine Learning, and connect it with Power BI through Power Automate and Power Apps. This setup involves creating a real-time endpoint for the model in Azure, which can process data queries or provide insights on-demand as users interact with Power BI visuals. This approach requires setup in both Power Automate (for API calls) and Power Apps (to handle input/output), and can be customized for specific types of data analysis tasks, such as summarization or sentiment analysis.

3. **Fine-tuning LLMs for Specific Data Needs**: If your business requires domain-specific insights, consider fine-tuning an LLM to your dataset. Azure provides resources for fine-tuning, allowing you to train the model with data that is most relevant to your industry or analytical needs. This fine-tuned model can then offer more accurate predictive analytics, trend analysis, and data descriptions, especially useful for industries with complex datasets, like healthcare or finance.

Each of these methods leverages the Azure OpenAI service for model hosting, making LLMs accessible to Power BI in ways that streamline data interpretation and reporting processes without requiring extensive SQL or DAX knowledge. For further guidance, Microsoft’s documentation and community forums offer step-by-step resources for deploying these models in Power BI environments.

For more details, check resources from Microsoft and Dataproducts.io for practical steps on setting up and fine-tuning LLMs with Power BI.

Yes, but where is the correct video link?

lbendlin
Super User
Super User

Check out chatPowerBI!

 

Our product integrates large language models (LLMs) directly into Power BI, allowing you to query your data easily and efficiently. It supports multiple languages, not just English. We also support various models from OpenAI and Anthropic, and you can even bring your own LLM deployment (BYO LLM).


Watch our video demo

chatPowerBI_0-1726587697270.png

 

Hi @chatPowerBI , the demo video location is invalid, can you post it once again? many thanks!!

Hey @prosar , just updated the video link. Thanks! 

thanks a lot. got it!

Helpful resources

Announcements
New to Fabric survey Carousel

New to Fabric Survey

If you have recently started exploring Fabric, we'd love to hear how it's going. Your feedback can help with product improvements.

Power BI DataViz World Championships carousel

Power BI DataViz World Championships - June 2026

A new Power BI DataViz World Championship is coming this June! Don't miss out on submitting your entry.

Join our Fabric User Panel

Join our Fabric User Panel

Share feedback directly with Fabric product managers, participate in targeted research studies and influence the Fabric roadmap.

March Power BI Update Carousel

Power BI Community Update - March 2026

Check out the March 2026 Power BI update to learn about new features.