Forum Discussion
Copilot, limitations?
- 8 months ago
Thank you for the follow-up — and I genuinely understand your frustration. You’re not wrong that, from a human perspective, this is a very simple arithmetic problem, and yes, ChatGPT can solve it easily.
However, the key point is that Copilot in Power BI is not failing at math — it is refusing to cross semantic boundaries it is not allowed to cross.
What you are describing is a cross-report reconciliation problem, not a calculation problem.
When you say:
“Report A says 100,000 passengers in November
Report B splits November into 80,000 NS and 20,000 SN
How many of the 100,000 are NS vs SN?”For a human (or ChatGPT), the assumption is obvious: they refer to the same population.
For Copilot:
These are two separate semantic models
There is no guaranteed relationship
There is no shared grain or lineage
There is no enforced business rule that NS + SN = total passengers
Copilot is designed to not assume equivalence, even when it seems obvious.
That’s why it asks for:
The exact measure
The exact table
The exact relationship
All data inside the same model
It’s not intelligence vs stupidity — it’s governance vs inference.
Why ChatGPT “works” here
ChatGPT:
Assumes the numbers are compatible
Ignores data lineage
Doesn’t care if the logic would be invalid in a governed BI system
Copilot:
Must avoid generating potentially wrong business answers
Cannot reconcile two reports unless they are backed by the same dataset
Cannot “peek” into another report or model
The real limitation (and you’re right to call it out)
Where I agree with you 100%:
Copilot does not currently help enough with reconciliation-style reasoning, even when:Measures exist
Names match
Logic is obvious to a human
That does limit its usefulness today for analysts doing validation, reconciliation, or sanity checks across reports.
So yes — for this use case, Copilot is not helpful. That’s a fair and valid conclusion.
The practical takeaway
Copilot works best when:
All numbers live in one semantic model
Relationships are explicit
Measures are already defined
For:
Cross-report summaries
Reconciliation
“Explain the difference between report A and report B”
Today, external reasoning tools (like ChatGPT) are still better.
You’re not misunderstanding Copilot — you’re simply hitting a real product boundary. Calling that out is fair, and it’s exactly the kind of feedback Microsoft needs to hear.
If this explanation helped clarify why this happens (even if you still disagree with the design), please consider giving Kudos 👍 and marking as the Accepted Answer ✔ so others don’t hit the same frustration without context.
Copilot isn’t a “bad AI” — it just has very strict limitations in Power BI right now, which is why it struggles with things that seem simple.
Why Copilot can’t answer some “easy” questions
Copilot can only work with measures and fields that already exist in the model.
If you ask for a % evolution between months, Copilot cannot create that logic on its own unless a measure already exists in the report. It doesn’t calculate new metrics on the fly.Copilot does not understand relationships across different reports or datasets.
It only works inside the dataset of the current report. So if you have 2 related reports, Copilot cannot “combine” their data in a single question.Copilot for Power BI is not a full analytical engine yet.
It mainly helps with:describing visuals
generating summaries
suggesting DAX when enough fields exist
creating simple visuals from existing data
But it cannot:
derive new KPIs without measures
combine multiple datasets
fix model design issues
perform multi-step reasoning like ChatGPT or other advanced models
Why ChatGPT can answer but Copilot cannot
ChatGPT is a general-purpose AI with reasoning ability.
Copilot for Power BI is restricted to what the dataset exposes and what the Power BI security model allows. It’s intentionally limited to avoid incorrect calculations or bypassing RLS.
In short
Copilot is not bad — it’s just early-stage and heavily limited.
To get better answers, you need to prepare the data model with all required measures, and Copilot will only work within that structure.