Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
2 years ago

Lakehouse data discrepancy between notebook and SQL endpoint or Dataflow

Hello everyone,   I’m experiencing an issue with a table in my Microsoft Fabric Lakehouse and I’m hoping someone can assist me.   Problem Description: I have a table in my Lakehouse that shows d...
Prince0011's avatar
Prince0011
Solution Sage
2 months ago

Quick Fix for Notebook Empty DataFrame

Step 1 — Clear Cache & Refresh

 
 
python
spark.catalog.clearCache()
spark.catalog.refreshTable("your_lakehouse.your_table")

Step 2 — Query the Table

 
 
python
df = spark.table("your_lakehouse.your_table")
display(df)

Still empty? Skip the catalog entirely:

 
 
python
df = spark.read.format("delta").load("abfss://your_path/Tables/your_table")
display(df)

Step 3 — If Nothing Works

Run → Stop Session in the notebook ribbon, then re-run.

A fresh Spark session clears all stale metadata automatically. ✅