Forum Discussion
Advocate IPython Notebook duckdb/delta intermittent permission errors
The error is from DuckDB’s Delta Kernel when reading _delta_log files — it’s not a real permission issue, but an intermittent I/O/concurrency bug in Fabric.
✅ Fixes
Add retry logic around DuckDB queries.
Avoid concurrent Spark + DuckDB reads on the same table.
Keep DuckDB/Fabric runtime updated.
If critical, use Spark SQL instead of DuckDB for stability.
👉 It’s a platform-side intermittent bug, not your config.
Community ChampionThe error is from DuckDB’s Delta Kernel when reading _delta_log files — it’s not a real permission issue, but an intermittent I/O/concurrency bug in Fabric.
✅ Fixes
Add retry logic around DuckDB queries.
Avoid concurrent Spark + DuckDB reads on the same table.
Keep DuckDB/Fabric runtime updated.
If critical, use Spark SQL instead of DuckDB for stability.
👉 It’s a platform-side intermittent bug, not your config.
Advocate IThis is what I was expecting it to be. Have added retry logic in for now and hopefully gets fixed soon.
Data is too small to consider spark which is why we went with the DuckDB pattern, just strange it has been fine for months and suddenly an issue.
v-lgarikapatCommunity Support
Hi abm_chris Thank you for sharing this workaround it's truly appreciated and will be incredibly helpful for others in the community.
We truly appreciate your continued engagement and thank you for being an active and valued member of the community.
Best Regards,
Lakshmi.
- abm_chris
I'll still be waiting for a fix from PG 👍