I would like to be able to utilise and benefit from the Data Catalog Data Lineage, even when I am not utilising the required Pipeline Activities that generate Data Lineage metadata.
I think this should be easy to do, if we can expose at least parts of the the api via python, so that when we are creating notebooks, we can setup similar metadata to our pipelines, allowing notebooks to be included in the data lineage. Possibly even allow this for SQL type code that could be executed as well.
No CommentsBe the first to comment
