Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Next up in the FabCon + SQLCon recap series: The roadmap for Microsoft SQL and Maximizing Developer experiences in Fabric. All sessions are available on-demand after the live show. Register now

Reply
Eleanordum
Frequent Visitor

Get Fabric Pipeline activities output into log table

Hi everyone,

 

In a Fabric pipeline, there is an option to export the output of it:

Eleanordum_0-1771488040366.png

 

The CSV file looks like this:

Eleanordum_1-1771488107799.png

 

I need to log this exact information into an audit table - so after each pipeline run i want to log all the details of the activities - name, run start, run end, duration. I don't seem to find a way to do it, so your help is very much appreciated!

 

Thank you!

 

 

1 ACCEPTED SOLUTION
deborshi_nag
Resident Rockstar
Resident Rockstar

Hello @Eleanordum 

 

The Export to CSV function lets you quickly download the activities or runs you see on your screen, which can be useful for a fast review or to share by email. It only exports what you currently see in the browser, and isn’t connected to a service you can call directly.

 

You can turn on Workspace Monitoring in Fabric, but right now it only shows information at the pipeline level (L1). Activity-level details (L2) aren’t yet available in the Eventhouse/KQL logs.

 

The current workaround is to use Custom activity logging. For each important activity, you can record details like:

  • The pipeline run ID
  • Activity name and type
  • Where the data is going (lakehouse, file, batch ID)
  • Status and any error messages
  • Start and end times, plus metrics

After that, you can use ItemJobEventLogs to check overall health and alerts for runs, and your custom table to look into specific activity details. This is the standard method used in organizations today.

 

I trust this will be helpful. If you found this guidance useful, you are welcome to acknowledge with a Kudos or by marking it as a Solution.

View solution in original post

4 REPLIES 4
V-yubandi-msft
Community Support
Community Support

Hi @Eleanordum ,

We haven’t received a response from your end yet. Please let us know whether the issue has been resolved or if you’re still facing any difficulties. Feel free to reach out if you need further assistance.

 

Thank you.

V-yubandi-msft
Community Support
Community Support

Hi @Eleanordum ,

@deborshi_nag, has correctly pointed out the issue and shared a few steps to follow. Have you tried those steps, and did they help? If you are still facing any issues or need additional information, please let us know.

 

Thanks for your valuable response @deborshi_nag   .

 

Regards,

Yugandhar.

AhmedMamdoh
Advocate III
Advocate III

Okay 

deborshi_nag
Resident Rockstar
Resident Rockstar

Hello @Eleanordum 

 

The Export to CSV function lets you quickly download the activities or runs you see on your screen, which can be useful for a fast review or to share by email. It only exports what you currently see in the browser, and isn’t connected to a service you can call directly.

 

You can turn on Workspace Monitoring in Fabric, but right now it only shows information at the pipeline level (L1). Activity-level details (L2) aren’t yet available in the Eventhouse/KQL logs.

 

The current workaround is to use Custom activity logging. For each important activity, you can record details like:

  • The pipeline run ID
  • Activity name and type
  • Where the data is going (lakehouse, file, batch ID)
  • Status and any error messages
  • Start and end times, plus metrics

After that, you can use ItemJobEventLogs to check overall health and alerts for runs, and your custom table to look into specific activity details. This is the standard method used in organizations today.

 

I trust this will be helpful. If you found this guidance useful, you are welcome to acknowledge with a Kudos or by marking it as a Solution.

Helpful resources

Announcements
FabCon and SQLCon Highlights Carousel

FabCon &SQLCon Highlights

Experience the highlights from FabCon & SQLCon, available live and on-demand starting April 14th.

New to Fabric survey Carousel

New to Fabric Survey

If you have recently started exploring Fabric, we'd love to hear how it's going. Your feedback can help with product improvements.

Join our Fabric User Panel

Join our Fabric User Panel

Share feedback directly with Fabric product managers, participate in targeted research studies and influence the Fabric roadmap.

March Fabric Update Carousel

Fabric Monthly Update - March 2026

Check out the March 2026 Fabric update to learn about new features.