Co-pilot in Fabric

[vi1996ash]

Does Copilot uses Fabric capacity? In case the capacity is 100% utilized will copilot work?

[vi1996ash]

Hi @v-nikhilan-msft,
I have a follow-up question: What is the additional cost incurred if the co-pilot runs after 100% capacity for 10 minutes?

[v-nikhilan-msft]

Hi @vi1996ash 
We do not have the information regarding the additional costs incurred after the 100% capacity has been used. You can use the Capacity Metrics App to understand the capacity usage.

https://learn.microsoft.com/en-us/fabric/enterprise/metrics-app
Hope this helps.

[v-nikhilan-msft · Accepted solution]

Hi @vi1996ash 
Thanks for using Fabric Community.

Yes, Copilot does use Fabric capacity. Copilot usage is measured by the number of tokens processed, and these tokens consume Fabric Capacity Units (CU). The consumption rate for Copilot in Fabric is 400 CU seconds per 1,000 input tokens and 1,200 CU seconds per 1,000 output tokens.
Copilot consumption - Microsoft Fabric | Microsoft Learn

If the Fabric capacity is 100% utilized, it means that you have fully utilized the available computing power. When a capacity consumes all its available CU resources for the next 10 minutes, the first phase of throttling begins. In such a scenario, you might experience issues with loading models or running operations.

However, Fabric has a feature called “bursting” that allows you to consume extra compute resources beyond what have been purchased to speed the execution of a workload.

If you’re reaching capacity limits frequently, you might need to consider increasing your SKU capacity. Also, you can enable AI and Copilot for a specific Capacity, which allows you to test Copilot at a certain capacity without impacting other workloads.
Fabric Capacities – Everything you need to know about what’s new and what’s coming | Microsoft Fabri...
Microsoft Fabric April 2024 Update | Microsoft Fabric Blog | Microsoft Fabric

Hope this helps. Please let me know if you have any further questions.