Forum Discussion

Bhargava05's avatar
Bhargava05
Resolver II
1 year ago
Solved

Track Lakehouse Table Lineage

Hi,

 

Is there a way we can track the table lineage as in which notebook or pipeline loaded it into a lakehouse as such?

 

  • Anonymous's avatar
    Anonymous
    1 year ago

    Hi Bhargava05 ,

    Thank you for reaching out to Microsoft fabric community forum.

     

    In Microsoft Fabric, you can use the Lineage View within your workspace to track which notebook, pipeline, or dataflow is connected to a Lakehouse. This helps visualize artifact-level data movement. However, lineage tracking at the individual table level within a Lakehouse such as identifying exactly which notebook or pipeline loaded a specific table is not currently supported.

     

    As a workaround, you can implement custom logging within your notebooks or pipelines to capture metadata like load timestamps and source identifiers. For details on current lineage capabilities, you can refer to the official documentation here: Lineage in Fabric – Microsoft Learn

    If table-level lineage is important for your scenario, we encourage you to submit this as feedback or upvote similar suggestions on Fabric Ideas - Microsoft Fabric Community to help the product team prioritize this feature in future updates.

     

    Hope this helps. Please reach out for further assistance.

    If this post helps, then please consider to Accept as the solution to help the other members find it more quickly and a kudos would be appreciated.

     

    Thank you.

4 Replies

  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi Bhargava05 ,

    I wanted to check if you had the opportunity to review the information provided. Please feel free to contact us if you have any further questions. If my response has addressed your query, please accept it as a solution and give a 'Kudos' so other members can easily find it.

    Also thank you Srisakthi  for your insights.


    Thank you.

  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi Bhargava05 ,

    Thank you for reaching out to Microsoft fabric community forum.

     

    In Microsoft Fabric, you can use the Lineage View within your workspace to track which notebook, pipeline, or dataflow is connected to a Lakehouse. This helps visualize artifact-level data movement. However, lineage tracking at the individual table level within a Lakehouse such as identifying exactly which notebook or pipeline loaded a specific table is not currently supported.

     

    As a workaround, you can implement custom logging within your notebooks or pipelines to capture metadata like load timestamps and source identifiers. For details on current lineage capabilities, you can refer to the official documentation here: Lineage in Fabric – Microsoft Learn

    If table-level lineage is important for your scenario, we encourage you to submit this as feedback or upvote similar suggestions on Fabric Ideas - Microsoft Fabric Community to help the product team prioritize this feature in future updates.

     

    Hope this helps. Please reach out for further assistance.

    If this post helps, then please consider to Accept as the solution to help the other members find it more quickly and a kudos would be appreciated.

     

    Thank you.

  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi Bhargava05 ,

     

    Could you please confirm if you've submitted this as an idea in the Ideas Forum? If so, sharing the link here would be helpful for other community members who may have similar feedback.

    If we don’t hear back, we’ll go ahead and close this thread. For any further discussions or questions, please start a new thread in the Microsoft Fabric Community Forum  we’ll be happy to assist.

     

    Thank you for being part of the Microsoft Fabric Community.