Forum Discussion
Increase In Copy Activity CU Usage
- 1 year ago
Hi Dinesh - Thanks for the suggestions. I checked them all. This was an issue with every copy activity - and data movement was the operation where CU increase occurred. Our gateway is up to date. The pipeline has not changed.
Possible Good News: This morning, the CU usage returned to normal without any intervention or changes on our part. This makes me wonder if there was a bug. I will continue to watch through the week to make sure the issue doesn't recur.
Hi mheggie ,
Thank you for reaching out to the Microsoft Community Forum.
The sudden spike in CU usage for your copy activity's data movement tasks in Microsoft Fabric, despite unchanged data volumes and durations can be attributed to a few key factors.
Please check below things to fix the issue.
1. If your capacity was paused and resumed, Fabric may batch background operations like metadata processing or data movement immediately after resumption. This leads to CU spikes. Try to schedule pauses during low-usage periods and monitor post-resumption behavior.
2. Use the Health Page in Metrics App, Drill into the Compute and Storage pages to identify Background rejection rates, Throttling durations and Usage variance.
Please refer below Microsoft documents and communtity threads.
Solved: Lakehouse high CU usage, unknown source - Microsoft Fabric Community
Solved: Optimizing CU Usage in Microsoft Fabric - Microsoft Fabric Community
Solved: Re: Fabric Capacity Metrics: Interaction CU Freque... - Microsoft Fabric Community
Solved: Re: Increasing CU capacity usage running dataflows - Microsoft Fabric Community
Solved: Re: Fabric CU Usage - Microsoft Fabric Community
Solved: Discrepancy in CU Consumption Between Fabric Capac... - Microsoft Fabric Community
Understand the metrics app health page (preview) - Microsoft Fabric | Microsoft Learn
I hope this information helps. Please do let us know if you have any further queries.
Regards,
Dinesh
Thanks for the suggestions. I went through your list and found the following:
- We have not paused our capacity
- We have no background rejection or throttling. We haven't exceeded our capacity. We just observed a significant increase in the CU usage.
Any other ideas?
- v-dineshya1 year ago
Community Support
Hi mheggie ,
1. Please monitor via Metrics App, Use the Item History and Compute tabs to track trends and identify any new patterns.
2. Batch or Consolidate Copy Activities, If feasible reduce the number of individual copy activities by batching data or using wildcards.
3. In Metrics App’s Compute Page, Sort by CU usage and identify which pipeline or operation is consuming the most. Hover over the top items to see if the spike is due to data movement or refresh.
4. Confirm if your gateway was updated to version 3000.282. Review if any new features are enabled that weren’t before.5. Check the pipeline is still using Append mode and not inadvertently switched to Incremental or Overwrite. Validate that no hidden transformations or schema validations were introduced.
I hope this information helps. Please do let us know if you have any further queries.
Regards,
Dinesh
- mheggie1 year agoFrequent Visitor
Hi Dinesh - Thanks for the suggestions. I checked them all. This was an issue with every copy activity - and data movement was the operation where CU increase occurred. Our gateway is up to date. The pipeline has not changed.
Possible Good News: This morning, the CU usage returned to normal without any intervention or changes on our part. This makes me wonder if there was a bug. I will continue to watch through the week to make sure the issue doesn't recur.