Forum Discussion
Solved
Duplicated rows between notebook and SQL Endpoint
I'm having troubles when trying to count the number of rows in my table from Lakehouse. If I count the rows from SQL Endpoint, I get 221555 rows, if I read the table from notebook and then I coun...
Hi all, there's apparently a bug where the metadata on which parquet file is the latest and greatest can get hosed up between the lakehouse SQL endpoint and the notebooks. I worked a ticket with Microsoft and they had me run the following code. After running it, wait 30 minutes or so to retry running the notebook. In my case this perfectly fixed the issue.
mssparkutils.fs.unmount("/default", {"scope": "default_lh"})sc._jvm.com.microsoft.spark.notebook.common.trident.TridentRuntimeContext.reset()sc._jvm.com.microsoft.spark.notebook.common.trident.TridentRuntimeContext.personalizeSession()Hope this helps,Scott
Hi amaaiia
Thanks for using Fabric Community.
Can you please provide the screenshots for the SQL code and the notebook code? This would help me to understand the question better.
Thanks