Forum Discussion
Solved
Fabric pipelines audit
Hi community, I am looking for a way to log pipelines details into an audit delta table. To be more specific, I want to log the start time, end time, status, error message if any etc. Having this by...
Hi Eleanordum93,
I would recommend creating a UDF that accepts the things you want to log as parameters, and then saves them to a warehouse or SQL database. THen you can call that UDF from the pipeline (or from a notebook, or from anywhere else really) to log something.
This is better than using a notebook because it doesn't require a spark session to be created so will be cheaper on compute/CU usage.
v-aatheeque
Community Support
Community SupportHi Eleanordum93
Have you had a chance to look through the responses shared earlier? If anything is still unclear, we’ll be happy to provide additional support.