Forum Discussion
Increasing CU capacity usage running dataflows
- Anonymous2 years ago
Hi, SaiTejaTalasila
thanks for your concern about this issue.
Your method is also a solution.
And I would like to share some additional solutions below.
I am glad to help you.
According to your description, you want to know what causes this exceeding CU growth for just a few simple dataflows?
If I understand you correctly, then you can refer to my solution.
Check the complexity of the data flow: Even if the data flow seems simple, make sure there is no hidden complexity or inefficiency. Some transformation operations may be more resource-intensive than expected, so you can check for transformations and optimize some of them appropriately.
Throttling Policies: Understand and configure throttling policies to manage and balance performance and reliability.
Monitor CU Usage: Use the Microsoft Fabric Capacity Metrics app to monitor CU usage. This helps determine if there are specific times or operations that cause spikes.
Adjust Scheduling: Instead of running streams every hour, try staggering times or running streams during off-peak hours to distribute the load more evenly.
Increase Capacity: If your current capacity is consistently reaching its limits, consider increasing Fabric capacity to better handle the load.
Here's the official documentation, hope it helps:
Understand your Fabric capacity throttling - Microsoft Fabric | Microsoft Learn
I hope my suggestions give you good ideas, if you have any more questions, please clarify in a follow-up reply.
Best Regards,
Fen Ling,
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Hi,
This is not the answer to my guestion. I've read all the documentation and what I said, it's just a very simple dataflow I've scheduled that causes this issue.
We're using the F64 capacity and I guess that's enough?
Hi, remconicolai-
You mentioned that you are using F64, I think you can check out these two documents below to learn more about F64 in general.
Microsoft Fabric features by SKU - Microsoft Fabric | Microsoft Learn
Capacity metrics in Microsoft Fabric | Microsoft Fabric Blog | Microsoft Fabric
I hope my suggestions give you good ideas, if you have any more questions, please clarify in a follow-up reply.
Best Regards,
Fen Ling,
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.