Forum Discussion

Kuladeep's avatar
Kuladeep
Icon for Advocate II rankAdvocate II
22 days ago
Solved

Table level or Columns level lineage

Hallo Community, is it possible to trace the source tables and columns used in a report? I understand that intermediate transformations can change the tables and columns during the process. However...
data engineering
lakehouse
Notebook
  • EduardoCastro's avatar
    EduardoCastro
    22 days ago

    Hallo,

    Yes, it is possible — and the fabric-toolbox repository provides a ready-made solution for this exact scenario.

    Microsoft's fabric-toolbox includes a Lineage Extractor notebook that automatically extracts column-level metadata from Fabric artifacts and uploads it to Microsoft Purview to create a graphical lineage graph.

    You can take a look at 

    https://github.com/microsoft/fabric-toolbox/tree/9dcbc14496f4f6342f3af1f482073ff0be0d91e0/tools/Lineage_Extractor

     

EduardoCastro's avatar
EduardoCastro
Icon for Helper I rankHelper I
22 days ago

Hallo,

Yes, it is possible — and the fabric-toolbox repository provides a ready-made solution for this exact scenario.

Microsoft's fabric-toolbox includes a Lineage Extractor notebook that automatically extracts column-level metadata from Fabric artifacts and uploads it to Microsoft Purview to create a graphical lineage graph.

You can take a look at 

https://github.com/microsoft/fabric-toolbox/tree/9dcbc14496f4f6342f3af1f482073ff0be0d91e0/tools/Lineage_Extractor

 

Kuladeep's avatar
Kuladeep
Icon for Advocate II rankAdvocate II
21 days ago

I think this works solution upto some extent of our usecase. I will test this and get back here