How monitoring the consumed CU for a running data pipeling

[pmscorca]

Hi,

in order to check the execution of a data pipeline I need to monitor the related consumed CU.

The Activity runs doesn't show any information about it in order to keep under control the Fabric capacity.

Any suggests to me, please? Thanks

[v-nmadadi-msft]

Hi @pmscorca,

As we haven’t heard back from you, we wanted to kindly follow up to check if the solution provided by the community members for the issue worked. If our response addressed, please mark it as Accept as solution and click Yes if you found it helpful.

Thanks and regards

[v-nmadadi-msft]

Hi @pmscorca

I wanted to check if you had the opportunity to review the information provided. Please feel free to contact us if you have any further questions. If our responses has addressed your query, please accept it as a solution and give a 'Kudos' so other members can easily find it.

Thank you.

[v-nmadadi-msft]

Hi @pmscorca,

May I ask if you have resolved this issue? If so, please mark the helpful reply and accept it as the solution. This will be helpful for other community members who have similar problems to solve it faster.

Thank you.

[lbendlin · Accepted solution]

Different from classic Power BI workloads like semantic model and DF Gen1 refreshes, the CUs for pipelines, notebooks and DF Gen2 start piling up as soon as the activity starts (ie doesn't wait for the activity to complete).  Then it plateaus for the smoothing period and then it decreases.  You will have to manually look at each of the 30 second slots in the Capacity Metrics App to find out how many CUs your pipeline is consuming in that slot.

[pmscorca]

Hi, so I have to control the consumed CU for a pipeline necessarily by the Capacity Metrics App and not outside of it. It's not very comfortable. How can I detect a pipeline run into the Capacity Metrics App? Thanks

[lbendlin]

Compute... Background. Filter by ItemKind.