topic Re: Push pipeline metadata into Microsoft Purview in Pipelines

Push pipeline metadata into Microsoft Purview

chakras — Tue, 29 Aug 2023 04:25:41 GMT

Hello

Is there a way I can push pipeline metadata (e.g. run time statistics, datasets information, lineage) to an existing Microsoft Purview data catalog from Fabric Data Factory?

Thanks

Sankha

Re: Push pipeline metadata into Microsoft Purview

HimanshuS-msft — Tue, 29 Aug 2023 18:46:10 GMT

Hello chakras
Thanks for using the Fabric community.

As per the documet here , it is something on the roadmap .

Thanks
HImanshu

Re: Push pipeline metadata into Microsoft Purview

zeesoft — Sat, 02 Sep 2023 03:55:19 GMT

Hello chakras

The last two pipeline metadata you mentioned above seemed right to me, but not the run time statistics, which essentially comes from the pipeline execution logs. Do you agree?

Thanks!