Don't miss your chance to take the Fabric Data Engineer (DP-600) exam for FREE! Find out how by attending the DP-600 session on April 23rd (pacific time), live or on-demand.
Learn moreNext up in the FabCon + SQLCon recap series: The roadmap for Microsoft SQL and Maximizing Developer experiences in Fabric. All sessions are available on-demand after the live show. Register now
Hi everyone,
In a Fabric pipeline, there is an option to export the output of it:
The CSV file looks like this:
I need to log this exact information into an audit table - so after each pipeline run i want to log all the details of the activities - name, run start, run end, duration. I don't seem to find a way to do it, so your help is very much appreciated!
Thank you!
Solved! Go to Solution.
Hello @Eleanordum
The Export to CSV function lets you quickly download the activities or runs you see on your screen, which can be useful for a fast review or to share by email. It only exports what you currently see in the browser, and isn’t connected to a service you can call directly.
You can turn on Workspace Monitoring in Fabric, but right now it only shows information at the pipeline level (L1). Activity-level details (L2) aren’t yet available in the Eventhouse/KQL logs.
The current workaround is to use Custom activity logging. For each important activity, you can record details like:
After that, you can use ItemJobEventLogs to check overall health and alerts for runs, and your custom table to look into specific activity details. This is the standard method used in organizations today.
Hi @Eleanordum ,
We haven’t received a response from your end yet. Please let us know whether the issue has been resolved or if you’re still facing any difficulties. Feel free to reach out if you need further assistance.
Thank you.
Hi @Eleanordum ,
@deborshi_nag, has correctly pointed out the issue and shared a few steps to follow. Have you tried those steps, and did they help? If you are still facing any issues or need additional information, please let us know.
Thanks for your valuable response @deborshi_nag .
Regards,
Yugandhar.
Okay
Hello @Eleanordum
The Export to CSV function lets you quickly download the activities or runs you see on your screen, which can be useful for a fast review or to share by email. It only exports what you currently see in the browser, and isn’t connected to a service you can call directly.
You can turn on Workspace Monitoring in Fabric, but right now it only shows information at the pipeline level (L1). Activity-level details (L2) aren’t yet available in the Eventhouse/KQL logs.
The current workaround is to use Custom activity logging. For each important activity, you can record details like:
After that, you can use ItemJobEventLogs to check overall health and alerts for runs, and your custom table to look into specific activity details. This is the standard method used in organizations today.
Experience the highlights from FabCon & SQLCon, available live and on-demand starting April 14th.
If you have recently started exploring Fabric, we'd love to hear how it's going. Your feedback can help with product improvements.
Share feedback directly with Fabric product managers, participate in targeted research studies and influence the Fabric roadmap.
| User | Count |
|---|---|
| 7 | |
| 4 | |
| 3 | |
| 3 | |
| 3 |