How to get the Microsoft Fabric pipeline run time in to the Fabric Warehouse Table

[kasun_rumesh]

I want to get the Microsoft Fabric pipeline run time in to the Fabric Warehouse Table.

[purushotham15 · Accepted solution]

Please try custom logging by adding some of the DB objects(like tables procedures) to add the data from pipeline. You can use SP activities at the beginning and end of the pipelines and also make use of system variables like runid, pipelinename..etc.

[FabianSchut]

@kasun_rumesh,

Another option is to use the MS Fabric API to retrieve the start and end time of a job and calculate the run time. You could look into this API: https://learn.microsoft.com/en-us/rest/api/fabric/core/job-scheduler/get-item-job-instance?tabs=HTTP

[kasun_rumesh]

Run time = Last refresh date and time I want.

[Houston-ho]

have you try to use a store procedure (custom self logging what you want, pipeline name, start run timestamp, etc.) as the first step of your pipeline? There may be a few seconds delay for the real pipeline run start time and the time of executing the SP. Not sure if that could fit your needs 100%.

[kasun_rumesh]

Run time = Last refresh date and time I want.