Data Lineage Visualization

[J4ns3n]

Hello,

I am currently exploring ways to improve the data lineage overview across multiple workspaces. Having successfully accessed the Microsoft API and collected data from various workspaces, I now face the challenge of visualizing this intricate web of data flow.

My goal is to create a comprehensive overview that allows users to delve deep into specific workspaces, reports, datasets, and dataflows. Specifically, I want to highlight any loading errors, identify their sources, and assess whether they impact multiple reports.

If you have any suggestions or insights on achieving this, I would greatly appreciate your input.

[Manishlmn_89]

m also working on this almost  70% done, include decoding reports also column deatils from dax code or any business logic applied on report level. I m also looking for visuals to show case this data.

[J4ns3n]

Hi Clara, 

Thank you for your reply, but I was more looking to a way to show it to users of reports. This is because the lineage view can only be shown for 1 workspace and we have multiple workspaces. In addition, the lineage view that you suggested is hard to filter or make selections. I would prefer a visual that can be easily selected and can adjusted so errors in refreshes are highlighted. 

Thanks in advance. 

Best regards,

Joris

[Manishlmn_89]

I also developed this one, it included even column level information which page, which visual using particular column from table. Im also looking for visuals to present all these info.

ex: https://vega.github.io/vega/examples/tree-layout/ this kind of tree layoput info.. once i complete this i will share..

[Anonymous]

Hi @J4ns3n ,

Power BI has multiple item types, such as dashboards, reports, semantic models, and data flows. Many semantic models and data flows connect to external data sources, such as SQL Server, and to external semantic models in other workspaces. When a semantic model is located outside of a workspace that you own, it may be located in a workspace that is owned by IT staff or other analysts. External data sources and semantic models ultimately make it more difficult to know where the data came from. For both complex and simple projects, we have introduced the lineage view.

In the descent view, the descent relationships between all the projects in the workspace and all their external dependencies can be seen. It shows the connections between all workspace items, including connections to upstream and downstream data flows.

More details can be found in the documentation: Data lineage - Power BI | Microsoft Learn.

If your Current Period does not refer to this, please clarify in a follow-up reply.

Best Regards,

Clara Gong

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.