Forum Discussion
High Copilot and AI cost
- 9 months ago
Hello AJAJ,
Thank you for posting your query in Microsoft Fabric Community Forum. Also, thanks to lbendlin , for those inputs on this thread.Copilot doesn’t charge based on how big your tables are. Even if the data is small, Copilot runs multiple background steps for every question a user asks. Because of that, the compute usage becomes a bit higher than what we normally expect with simple SQL or Power BI queries. So the cost you are seeing right now is normal behaviour.
When this goes to a bigger user base, the load comes mainly from the AI requests, not from the data size. That’s why higher capacities are usually suggested it’s just to handle the AI workload smoothly.
At the moment there isn’t any special setting to reduce Copilot-related cost. The best way is to limit who can use Copilot during the POC and keep checking the capacity metrics to understand where the usage is coming from.
Your current setup is fine, and you’re not using it incorrectly. This is simply how Copilot processes queries in the background.
Let me know if you want me to check anything specific.
Regards,
Community Support Team.
F4 is way too small for that. for 300+ users you are looking at a minimum of F128
- AJAJ9 months agoHelper IV
My eyebrows jumped out of my face 😄
Can you plz help me what am i missing. why F128 is needed for 1GB of data in total? worstcase 5gb of data since dim / facts are designed compact. The queries are running in seconds whatever way data is sliced. 70m fact rows. Thats in F4. PBI would get copy of it and users would be hitting pre canned power bi report once a while. Not all users would be hitting the PBI at the same. I assume F64 itself would be waaaayyyyy too much power but kind a breaks even on PBI license. $15/month for 300 users= $4500 per month.
Just trying to understand- lbendlin9 months agoSuper User
We recently did a test of Copilot queries an a similar sized semantic model on a F64. It took 15 concurrent users about 10 minutes to completely overwhelm the capacity.
- AJAJ9 months agoHelper IV
Thanks good to know. Will definitely keep an eye.
Will wait for someone to give more insights how best ai copilot cost could be reduced.