Forum Discussion
Fabric Capacity SKU Concept - Compute and Storage
- 1 year ago
Did you get a specific error message?
Did you have a look in the Fabric Capacity Metrics App to see if your capacity's compute has been over utilized?
If your capacity is in a throttling or rejection state, it might mean you are not able to access the data via the Fabric workloads. Because reading/writing data consumes some capacity compute resources.
https://learn.microsoft.com/en-us/fabric/onelake/onelake-consumption#transactions
https://learn.microsoft.com/en-us/fabric/enterprise/throttling
If you are indeed experiencing throttling, there are some ways to pay to get rid of the throttling. Or I think you need to wait. If you choose to pause your capacity in order to get rid of the throttling, you will get billed extra.
https://learn.microsoft.com/en-us/fabric/enterprise/pause-resume
"When you pause your capacity, the remaining cumulative overages and smoothed operations on your capacity are summed, and added to your Azure bill. You can monitor a paused capacity using the Microsoft Fabric Capacity Metrics app.
If your capacity is being throttled, pausing it stops the throttling and returns your capacity to a healthy state immediately. This behavior enables you to pause your capacity as a self-service mechanism that ends throttling."
So if you are experiencing throttling, perhaps you just need to wait it out if you don't want to pay any extra. Or you can consider ways of paying to get out of the throttling state. E.g. pausing and resuming the capacity is a way of paying extra to get out of the throttling state.
I don't think there is a OneLake storage limit which depends on F SKU size. I haven't heard anything about that, at least.
Obviously the compute capacity is less on an F2 vs. an F64.
But I think the storage capacity is the same on both ("unlimited").
However you pay separately for OneLake storage, so don't go nuts ☺️
Reads/writes on the data consumes compute CUs. So having more data could put more load on the F SKU capacity if you're doing reads or writes.
https://learn.microsoft.com/en-us/fabric/onelake/onelake-capacity-consumption
https://learn.microsoft.com/en-us/fabric/onelake/onelake-consumption
https://azure.microsoft.com/en-us/pricing/details/microsoft-fabric/
Thank you frithjof_v for sharing your thoughts and documenatation links. The one thing that really bothers me is that when I started experiencing compute issues, I stopped the pipeline to prevent ingesting any further data. Then I should have all those resources available to simply preview the lakehouse table to see top 1000 records, but it was not even able to do that. I checked notebook, other lakehouse (that has one table with single record), data warehouse and I see same capacity issue there as well. So I'm wondering capacity SKU's somehow linked to the amount of available data in Onelake (lakehouses, warehouse) and It only works when the amount of data is lower than it's threshold point??
- frithjof_v1 year agoCommunity Champion
Did you get a specific error message?
Did you have a look in the Fabric Capacity Metrics App to see if your capacity's compute has been over utilized?
If your capacity is in a throttling or rejection state, it might mean you are not able to access the data via the Fabric workloads. Because reading/writing data consumes some capacity compute resources.
https://learn.microsoft.com/en-us/fabric/onelake/onelake-consumption#transactions
https://learn.microsoft.com/en-us/fabric/enterprise/throttling
If you are indeed experiencing throttling, there are some ways to pay to get rid of the throttling. Or I think you need to wait. If you choose to pause your capacity in order to get rid of the throttling, you will get billed extra.
https://learn.microsoft.com/en-us/fabric/enterprise/pause-resume
"When you pause your capacity, the remaining cumulative overages and smoothed operations on your capacity are summed, and added to your Azure bill. You can monitor a paused capacity using the Microsoft Fabric Capacity Metrics app.
If your capacity is being throttled, pausing it stops the throttling and returns your capacity to a healthy state immediately. This behavior enables you to pause your capacity as a self-service mechanism that ends throttling."
So if you are experiencing throttling, perhaps you just need to wait it out if you don't want to pay any extra. Or you can consider ways of paying to get out of the throttling state. E.g. pausing and resuming the capacity is a way of paying extra to get out of the throttling state.