Forum Discussion
abm_chris
Advocate I
Advocate IPython Notebook duckdb/delta intermittent permission errors
Hi, I have been having intermittent issues over the past couple of weeks with duckdb executing sql queries and getting the below error: IOException: IO Error: Hit DeltaKernel FFI error (from: ...
The error is from DuckDB’s Delta Kernel when reading _delta_log files — it’s not a real permission issue, but an intermittent I/O/concurrency bug in Fabric.
✅ Fixes
Add retry logic around DuckDB queries.
Avoid concurrent Spark + DuckDB reads on the same table.
Keep DuckDB/Fabric runtime updated.
If critical, use Spark SQL instead of DuckDB for stability.
👉 It’s a platform-side intermittent bug, not your config.
BhaveshPatel
Super User
Super UserYou can observe such issues with Microsoft Fabric Delta Lake. It is an open source & relatively new platform. But my question is why are you using Duckdb.
Instead use pyspark and delta lake to get in memory engine features.
python --> pyspark --> delta lake. This is how databricks has designed the data architecture.