topic Re: How monitoring the consumed CU for a running data pipeling in Pipelines

How monitoring the consumed CU for a running data pipeling

pmscorca — Wed, 09 Apr 2025 13:20:28 GMT

Hi,

in order to check the execution of a data pipeline I need to monitor the related consumed CU.

The Activity runs doesn't show any information about it in order to keep under control the Fabric capacity.

Any suggests to me, please? Thanks

Re: How monitoring the consumed CU for a running data pipeling

lbendlin — Wed, 09 Apr 2025 23:35:56 GMT

Different from classic Power BI workloads like semantic model and DF Gen1 refreshes, the CUs for pipelines, notebooks and DF Gen2 start piling up as soon as the activity starts (ie doesn't wait for the activity to complete). Then it plateaus for the smoothing period and then it decreases. You will have to manually look at each of the 30 second slots in the Capacity Metrics App to find out how many CUs your pipeline is consuming in that slot.

Re: How monitoring the consumed CU for a running data pipeling

pmscorca — Thu, 10 Apr 2025 05:16:04 GMT

Hi, so I have to control the consumed CU for a pipeline necessarily by the Capacity Metrics App and not outside of it. It's not very comfortable. How can I detect a pipeline run into the Capacity Metrics App? Thanks

Re: How monitoring the consumed CU for a running data pipeling

lbendlin — Thu, 10 Apr 2025 10:15:27 GMT

Compute... Background. Filter by ItemKind.

Re: How monitoring the consumed CU for a running data pipeling

Anonymous — Sun, 13 Apr 2025 18:21:25 GMT

Hi pmscorca,

May I ask if you have resolved this issue? If so, please mark the helpful reply and accept it as the solution. This will be helpful for other community members who have similar problems to solve it faster.

Thank you.

Re: How monitoring the consumed CU for a running data pipeling

Anonymous — Fri, 18 Apr 2025 09:24:09 GMT

Hi pmscorca

I wanted to check if you had the opportunity to review the information provided. Please feel free to contact us if you have any further questions. If our responses has addressed your query, please accept it as a solution and give a 'Kudos' so other members can easily find it.

Thank you.

Re: How monitoring the consumed CU for a running data pipeling

Anonymous — Tue, 22 Apr 2025 16:33:11 GMT

Hi pmscorca,

As we haven’t heard back from you, we wanted to kindly follow up to check if the solution provided by the community members for the issue worked. If our response addressed, please mark it as Accept as solution and click Yes if you found it helpful.

Thanks and regards