MS Fabric and MS Purview integration

[pallavi_r]

Hi Everyone,
Has anyone tried MS Purview integration with Fabric items. I did that but I noticed the assets that's getting identified does not included the delta tables residing in semantic model and even the csv files present in lakehouse are not identified. Even the lineage from one source to other is not captured.
Please help if anyone has success in identifying the delta table as assets from semantic models so I can further progress on cataloguing.

Thanks,
Pallavi

[pallavi_r · Accepted solution]

Hi All,

My issue got resolved. I am able to identify the power bi data assets now. I have added the purview managed indentity security group in the Fabric Workspace as contributer.

Please ensure that Fabric Tenant and Purview network is public, else private endpoint needs to be created for the same.

Thanks,

Pallavi

[Banu_Murali]

Hi Pallavi,

Hope you doing great !!

I am also facing same kind of issue in Purview not able to scan Lakehouse Delta tables in Purview. When I scan the Fabric workspace in Purview, I could able to see only Pipelines and Notebooks present in that workspace it doesn't identified Lakehouse tables as an asset. Prerequisites completed : Purview MSI granted with Contributor role access to our required workspace in Fabric and Enabled Fabric Tenant level settings with required Security group (where Purview MSI as a member).

Could you please help me to solve it, how to identify Lakehouse tables as an asset and extract Metadata details of lakehouse tables in Purview. 

Thanks in advance.

Regards,

BanuMurali

[pallavi_r]

Hi @Banu_Murali , 

This is something I had done 2 months back, so sharing the observation and detail as of october 24. 

-The metadata scan for all fabric item is done only at item level except power bi dataset.

-Lakehouse table metadata scanning and lineage was not available. So individual tables and column inside lakehouse table was not discovered. Only lakehouse item was shown.

-So I created a power bi report from the lakehouse->semantic model. And scanning extracted the metadata tables, column from power bi dataset along with basic lineage

-Data Quality did not work for either.

-I connected with Microsoft Support team. They did a great job and gave me detailed explaination saying quality scan for Lakehouse table is possible only whitelist the tenant. It is not available in public preview now, so if i raise a request to whitelist tenant  for lakehouse metadata scan and quality scan, then we can easily do it.

Please check the Microsoft documentation again, as it might be available now. And check with Microsoft Support Team for this.

If my answer helped you, then please give me a kudo.

Thanks,

Pallavi

[Banu_Murali]

Thanks @pallavi_r , It would help us.

[JohnHu]

Hi All,

I am also having this issue.  Custom semantic models in Fabric Workspaces appear in Purview as Power BI Datasets, however default semantic models (automatically created when a Lakehouse is created) are not ingested into Purview.  This is a huge issue.

This is a huge issue, because if I have 40 tables in a Lakehouse, in order to ingest them into Purview as Data Assets (Power BI Datasets), I would need to create a custom Semantic Model in Fabric for each table!  

Is there an easier way?

[pallavi_r]

Hi Team,

My power bi datasets from fabric workspace is not identified as assets in purview. Rest all items are getting captured. I have used managed identity as austhentication mechanism. Pleasw help.

Thanks,

Pallavi

[pallavi_r]

Yes @Expiscornovus , I am looking for delta table from lakehouse/semantic model in the discovered assets. So need a confirmation if anyone has success with it. Thanks, Pallavi

[Expiscornovus]

Hi @pallavi_r,

You are checking the data calog > data assets, correct?

I am not seeing the delta tables or csv files either. Not sure if they should show up there though.

Not seeing this type of items listedin the supported items list, so that might be the reason?

https://learn.microsoft.com/en-us/purview/register-scan-fabric-tenant?tabs=Scenario1#supported-capab...