Find unused and used columns

[AJAJ]

Hi there, 
I'm sure someone must have come across this. Something always lingering in mind.

Is there a way to find out if a column is used from any table or file. like run some query / code which shows this column is read by this SP / Notebook. There are hundreds of SP and hundreds of notebooks.

OneLake/ delta / parquet  or Datawarehouse.

- staging has 40,000+columns across 800+ tables. How to know which columns are not used in a SP / Notebook?

Thanks

[v-pgoloju]

Hi @AJAJ ,

Just following up to see if the Response provided by community members were helpful in addressing the issue. if the issue still persists Feel free to reach out if you need any further clarification or assistance.

Best regards,
Prasanna Kumar

[v-pgoloju]

Hi @AJAJ,

Thank you for reaching out to the Microsoft Fabric Forum Community, and special thanks to @tayloramy and @BhaveshPatel  for prompt and helpful responses.

Just following up to see if the Response provided by community members were helpful in addressing the issue.

If one of the responses helped resolve your query, please consider marking it as the Accepted Solution. Feel free to reach out if you need any further clarification or assistance.

Best regards,
Prasanna Kumar

[BhaveshPatel]

Hi @AJAJ ,

For that, You should use Microsoft Purview Audit and Power BI Direct Lake Approach. I have created a same tool long time ago. ( Technical Documention Dictionary).  Also, Make sure that Microsoft Fabric is SaaS ( Software as a Service ). Microsoft manages all data + metadata in Delta Lake ( Linux System ) and they are keeping an eye on everything. 

Fabric Lakehouse = Power BI Semantic Model + Power BI Dataflow Gen 2 = Fabric Warehouse = Delta Lake with Transaction Log + Apache Spark Data Lake Parquet Files  = Fabric SQL =  Unified Approach.

All are now called SQL Server Analysis Services = Azure Analysis Services = Power BI Premium = Fabric SQL = Power BI Dataflow Gen 2

Google is the master mind behind all this datasets. ( Bronze + Silver and Gold Layer etc.. etc..)

[tayloramy]

Hi @AJAJ, 

I'm not aware of a way to do this, but I agree that it could be useful in some cases. 

I recommend submitting an idea and seeing if the community agrees: Fabric Ideas - Microsoft Fabric Community

If you found this helpful, consider giving some Kudos. If I answered your question or solved your problem, mark this post as the solution.