Forum Discussion
Microsoft EmployeeCo-pilot in Fabric
Does Copilot uses Fabric capacity? In case the capacity is 100% utilized will copilot work?
Hi vi1996ash
Thanks for using Fabric Community.Yes, Copilot does use Fabric capacity. Copilot usage is measured by the number of tokens processed, and these tokens consume Fabric Capacity Units (CU). The consumption rate for Copilot in Fabric is 400 CU seconds per 1,000 input tokens and 1,200 CU seconds per 1,000 output tokens.
Copilot consumption - Microsoft Fabric | Microsoft LearnIf the Fabric capacity is 100% utilized, it means that you have fully utilized the available computing power. When a capacity consumes all its available CU resources for the next 10 minutes, the first phase of throttling begins. In such a scenario, you might experience issues with loading models or running operations.
However, Fabric has a feature called “bursting” that allows you to consume extra compute resources beyond what have been purchased to speed the execution of a workload.If you’re reaching capacity limits frequently, you might need to consider increasing your SKU capacity. Also, you can enable AI and Copilot for a specific Capacity, which allows you to test Copilot at a certain capacity without impacting other workloads.
Fabric Capacities – Everything you need to know about what’s new and what’s coming | Microsoft Fabric Blog | Microsoft Fabric
Microsoft Fabric April 2024 Update | Microsoft Fabric Blog | Microsoft Fabric
Hope this helps. Please let me know if you have any further questions.
4 Replies
Hi vi1996ash
Thanks for using Fabric Community.Yes, Copilot does use Fabric capacity. Copilot usage is measured by the number of tokens processed, and these tokens consume Fabric Capacity Units (CU). The consumption rate for Copilot in Fabric is 400 CU seconds per 1,000 input tokens and 1,200 CU seconds per 1,000 output tokens.
Copilot consumption - Microsoft Fabric | Microsoft LearnIf the Fabric capacity is 100% utilized, it means that you have fully utilized the available computing power. When a capacity consumes all its available CU resources for the next 10 minutes, the first phase of throttling begins. In such a scenario, you might experience issues with loading models or running operations.
However, Fabric has a feature called “bursting” that allows you to consume extra compute resources beyond what have been purchased to speed the execution of a workload.If you’re reaching capacity limits frequently, you might need to consider increasing your SKU capacity. Also, you can enable AI and Copilot for a specific Capacity, which allows you to test Copilot at a certain capacity without impacting other workloads.
Fabric Capacities – Everything you need to know about what’s new and what’s coming | Microsoft Fabric Blog | Microsoft Fabric
Microsoft Fabric April 2024 Update | Microsoft Fabric Blog | Microsoft Fabric
Hope this helps. Please let me know if you have any further questions.
vi1996ashHi Anonymous,
I have a follow-up question: What is the additional cost incurred if the co-pilot runs after 100% capacity for 10 minutes?Hi vi1996ash
We do not have the information regarding the additional costs incurred after the 100% capacity has been used. You can use the Capacity Metrics App to understand the capacity usage.https://learn.microsoft.com/en-us/fabric/enterprise/metrics-app
Hope this helps.
joakimfennoHelper V
Hi
my organisation are using an F16 fabric capacity (we will never have F64)
is it possbile to purchase fabric co-pilot when you have a capacity below F64?