Forum Discussion

Eleanordum's avatar
Eleanordum
Frequent Visitor
8 months ago
Solved

Get Fabric Pipeline activities output into log table

Hi everyone,   In a Fabric pipeline, there is an option to export the output of it:   The CSV file looks like this:   I need to log this exact information into an audit tabl...
  • deborshi_nag's avatar
    8 months ago

    Hello Eleanordum 

     

    The Export to CSV function lets you quickly download the activities or runs you see on your screen, which can be useful for a fast review or to share by email. It only exports what you currently see in the browser, and isn’t connected to a service you can call directly.

     

    You can turn on Workspace Monitoring in Fabric, but right now it only shows information at the pipeline level (L1). Activity-level details (L2) aren’t yet available in the Eventhouse/KQL logs.

     

    The current workaround is to use Custom activity logging. For each important activity, you can record details like:

    • The pipeline run ID
    • Activity name and type
    • Where the data is going (lakehouse, file, batch ID)
    • Status and any error messages
    • Start and end times, plus metrics

    After that, you can use ItemJobEventLogs to check overall health and alerts for runs, and your custom table to look into specific activity details. This is the standard method used in organizations today.