Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Be one of the first to start using Fabric Databases. View on-demand sessions with database experts and the Microsoft product team to learn just how easy it is to get started. Watch now

Reply
ChJahnavi
New Member

Data quality in Purview for fabric source

We have registered fabric workspace as data source in purview and were able to run scan on it. The received all the data assets in the workspace but not able to perform data quality on them. When we select onelake delta table asset we are facing this error: Required properties "lakehouseQualifiedName" missing. Try to refresh in the asset detail page.

All the details are filled in the asset detail page but still it is showing this message. Please help resolve it.

image.png

 

3 REPLIES 3
MelanieM
Frequent Visitor

Been struggling with this as well.  Can't seem to find any documentation around this error.  I went through the whole process of setting up Purview to test the data quality features and now I'm stuck on this last step.  It's beyond frustrating.

darwinposo
Frequent Visitor

Encountering the same problem.... Been looking for documentation on microsoft website and found.
Should i submit request to microsoft to allowlist my tenant for table scanning on lake house ?

 

 

Limitation

Purview Data map support for fabric Lakehouse is in private preview. We need to allow-list your purview tenant to Purview data map and Fabric OneLake to enable Fabric Lakehouse table DQ scanning with Purview DQ. Contact your Microsoft account team to allowlist your tenant for Fabric Lakehouse support.

Data Quality for Parquet file is designed to support:

  • A directory with Parquet Part File. For example: ./Sales/{Parquet Part Files}. The Fully Qualified Name must follow https://(storage account).dfs.core.windows.net/(container)/path/path2/{SparkPartitions}. Make sure we do not have {n} patterns in directory/sub-directory structure, must rather be a direct FQN leading to {SparkPartitions}.
  • A directory with Partitioned Parquet Files, partitioned by columns within the dataset like sales data partitioned by year and month. For example: ./Sales/{Year=2018}/{Month=Dec}/{Parquet Part Files}.

Both of these essential scenarios which present a consistent parquet dataset schema are supported. Limitation: It isn't designed to or won't support N arbitrary Hierarchies of Directories with Parquet Files. We advise the customer to present data in (1) or (2) constructed structure. So recommending customer to follow the supported parquet standard or migrate their data to ACID compliant delta format.

Data Quality for fabric data estate Limitation 

v-shex-msft
Community Support
Community Support

HI @ChJahnavi,

I'd like to suggest take a look the official document about the data quality feature limitation if they meet to your scenario:

Data quality for fabric Lakehouse data estate. | Microsoft Learn

Regards,

Xiaoxin Sheng

Community Support Team _ Xiaoxin
If this post helps, please consider accept as solution to help other members find it more quickly.

Helpful resources

Announcements
Las Vegas 2025

Join us at the Microsoft Fabric Community Conference

March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount!

ArunFabCon

Microsoft Fabric Community Conference 2025

Arun Ulag shares exciting details about the Microsoft Fabric Conference 2025, which will be held in Las Vegas, NV.

December 2024

A Year in Review - December 2024

Find out what content was popular in the Fabric community during 2024.