Forum Discussion

AJAJ's avatar
AJAJ
Icon for Helper IV rankHelper IV
11 months ago

Find unused and used columns

Hi there,  I'm sure someone must have come across this. Something always lingering in mind.   Is there a way to find out if a column is used from any table or file. like run some query / code whic...
data engineering
lakehouse
notebook
BhaveshPatel's avatar
BhaveshPatel
Icon for Super User rankSuper User
10 months ago

Hi AJAJ ,

 

For that, You should use Microsoft Purview Audit and Power BI Direct Lake Approach. I have created a same tool long time ago. ( Technical Documention Dictionary).  Also, Make sure that Microsoft Fabric is SaaS ( Software as a Service ). Microsoft manages all data + metadata in Delta Lake ( Linux System ) and they are keeping an eye on everything. 

 

Fabric Lakehouse = Power BI Semantic Model + Power BI Dataflow Gen 2 = Fabric Warehouse = Delta Lake with Transaction Log + Apache Spark Data Lake Parquet Files  = Fabric SQL =  Unified Approach.

 

All are now called SQL Server Analysis Services = Azure Analysis Services = Power BI Premium = Fabric SQL = Power BI Dataflow Gen 2

 

Google is the master mind behind all this datasets. ( Bronze + Silver and Gold Layer etc.. etc..)