Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
1 year ago
Solved

Lineage in Purview

Can we extract lineage in Purview for below fabric items :

1. Datamart
2. Dashboard
3. Dataset
4. Spark Job Defination

Can anyone help me in this ?

  • Anonymous's avatar
    Anonymous
    1 year ago

    Hi Anonymous 
    Thank you for reaching out microsoft fabric community forum.
    As  nilendraFabric  mentioned Yes, you can extract lineage for those fabric items in Microsoft Purview

    • Purview can capture lineage for data moving through your datamart, showing how data is transformed and processed.
    • Purview integrates with visualization platforms like Power BI to capture lineage of data used in dashboards.
    • Purview can track lineage for datasets, showing their origin, transformations, and how they are used.
    •  Purview can capture lineage for Spark jobs, detailing the data inputs, transformations, and outputs

    Please refer the documentation for more  information.
    Metadata and Lineage from Fabric | Microsoft Learn

    If you need any further assistance or have any questions, please feel free to reach  us.

     

    If this solution helps, please consider giving us Kudos and accepting it as the solution so that it may assist other members in the community.

4 Replies

  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi Anonymous 
    Thank you for reaching out microsoft fabric community forum.
    As  nilendraFabric  mentioned Yes, you can extract lineage for those fabric items in Microsoft Purview

    • Purview can capture lineage for data moving through your datamart, showing how data is transformed and processed.
    • Purview integrates with visualization platforms like Power BI to capture lineage of data used in dashboards.
    • Purview can track lineage for datasets, showing their origin, transformations, and how they are used.
    •  Purview can capture lineage for Spark jobs, detailing the data inputs, transformations, and outputs

    Please refer the documentation for more  information.
    Metadata and Lineage from Fabric | Microsoft Learn

    If you need any further assistance or have any questions, please feel free to reach  us.

     

    If this solution helps, please consider giving us Kudos and accepting it as the solution so that it may assist other members in the community.

  • hello Anonymous 

     

    yes this is available as part of integration 

     

    https://docs.azure.cn/en-us/purview/how-to-lineage-powerbi

    Once the scan of your Power BI is complete, following Power BI artifacts will be inventoried in Microsoft Purview:

    • Workspaces
    • Dashboards
    • Reports
    • Datasets
    • Dataflows
    • Datamart

    Spark Job Definitions, only item-level metadata and lineage are captured; sub-level details (e.g., table-level or file-level lineage) are not yet supported)


    Known limitations

    • Currently for all Fabric items besides Power BI, only item level metadata and lineage will be scanned. Scanning metadata and lineage of sub level items like Lakehouse tables or files isn't yet supported
    • For non-Power BI Fabric items, external data sources as upstream sources in lineage aren't yet supported
    • Cross workspace lineage for non-Power BI items isn't supported
    • Notebook -> Pipeline lineage isn't supported
     
    please accept this answer and give kudos if this is helpful 
    • Nai_edodo's avatar
      Nai_edodo
      Regular Visitor

      Hi,
      I was wondering what about column level lineage? Becuase I just scanned my PowerBi semantic model and i see that the lineage showing is only on the artefact level meaning model → dataset → report and no way to see the lineage in column level, because I'll like to see what columns nourishes the dataset and then the reports.
      Is this possible? or is there any walkaround to get to this result. 

      Thanks in advance

  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi Anonymous 

    May I ask if you have resolved this issue? If so, please mark the helpful reply and accept it as the solution. This will be helpful for other community members who have similar problems to solve it faster.

    Thank you.