Forum Discussion

JonBFabric's avatar
JonBFabric
Helper I
7 months ago
Solved

Comparing activity performance

Good Afternoon,   I would like to be able to directly compare the time and resource utilisation for multiple methods of loading data. Specifically I would like to compare using a dataflow and a pip...
  • v-hashadapu's avatar
    7 months ago

    Hi JonBFabric , Thank you for reaching out to the Microsoft Community Forum.

     

    There is currently no built in way in Fabric to directly compare CU consumption and execution time between a Dataverse load done via a dataflow and one done via a pipeline copy activity. Fabric does not expose ingestion method level benchmarking or side by side resource attribution. CU is surfaced as telemetry at the capacity, workspace and item execution level only.

     

    The best approach today is to run controlled, isolated tests. Execute the dataflow refresh and the pipeline copy separately, using the same Dataverse tables and similar data volumes, on the same capacity. Use item history (dataflow refresh history and pipeline run details) to capture duration, then correlate those time windows with CU usage in the Capacity Metrics app. This allows you to reasonably attribute CU and time to each method, provided nothing else is running on the capacity during those windows.

     

    The upcoming Capacity Operation Events preview will improve visibility by exposing operation level CU events, making this correlation cleaner, but it still won’t automatically compare ingestion methods for you. Even with that preview, a controlled test setup will remain necessary to get a fair and defensible comparison.