Get certified for free when you join Fabric Data Days 2026 and dive into Fabric, Power BI, SQL, AI, and other essential data skills.
Join now60 Days of Data Days! Live and on-demand sessions, challenges, study groups and more! And it's all FREE!. Join now. Learn more
In a regular python notebook I'm trying to write data to a delta table. It used to work but recently I either get this error in the pipeline run:
Or I get the following error when running the notebook manually:
Solved! Go to Solution.
Hi @Rob95
Adding a few points specific to regular Python notebooks that usually pinpoint this:
Pure-Python Delta writes are the most common cause. Regular Python notebooks use a small session pool and the deltalake library — once the DataFrame grows past a few hundred MB, the write fails and surfaces as this exact generic error. Running the same write in a PySpark notebook almost always resolves it.
Use the full ABFSS path. Default-lakehouse bindings can silently drop after workspace changes, making relative paths fail:
path = "abfss://<workspace>@onelake.dfs.fabric.microsoft.com/<lakehouse>.Lakehouse/Tables/<table>"
Check for capacity throttling. Under CU smoothing, Fabric returns this exact "please try again later" wording instead of a proper throttle error. Open the Fabric Capacity Metrics app and check the failure window.
Quick isolation test: run the write with df.head(100). If it succeeds, it's a compute/resource limit, not permissions or schema.
Capture the real error with:
------------------------------------
import traceback
try:
df.write.format("delta").mode("append").save(path)
except Exception:
traceback.print_exc()
raise
Could you confirm if it's a pure Python or PySpark notebook, and roughly the DataFrame size? That'll narrow it down quickly.
Thanks,
Srikanth Cheri
Community Support Team
Hi @Rob95
If you're using the Purepython or Python only runtime notebooks, you can use my blog post below, which I explain how to successfully write to the Lake house tables. https://www.fourmoo.com/2026/07/09/using-python-notebooks-to-merge-data-into-a-microsoft-fabric-lake...
I agree with @Asmita_27 and @v-csrikanth. Please provide more details or give the command that is throwing the error.
Hi @Rob95
Adding a few points specific to regular Python notebooks that usually pinpoint this:
Pure-Python Delta writes are the most common cause. Regular Python notebooks use a small session pool and the deltalake library — once the DataFrame grows past a few hundred MB, the write fails and surfaces as this exact generic error. Running the same write in a PySpark notebook almost always resolves it.
Use the full ABFSS path. Default-lakehouse bindings can silently drop after workspace changes, making relative paths fail:
path = "abfss://<workspace>@onelake.dfs.fabric.microsoft.com/<lakehouse>.Lakehouse/Tables/<table>"
Check for capacity throttling. Under CU smoothing, Fabric returns this exact "please try again later" wording instead of a proper throttle error. Open the Fabric Capacity Metrics app and check the failure window.
Quick isolation test: run the write with df.head(100). If it succeeds, it's a compute/resource limit, not permissions or schema.
Capture the real error with:
------------------------------------
import traceback
try:
df.write.format("delta").mode("append").save(path)
except Exception:
traceback.print_exc()
raise
Could you confirm if it's a pure Python or PySpark notebook, and roughly the DataFrame size? That'll narrow it down quickly.
Thanks,
Srikanth Cheri
Community Support Team
Transferring to a pyspark notebook is the easiest fix. The error code is a bit vague but thanks a lot for helping!
Hi @Rob95 ,
This error is unfortunately quite generic and usually doesn’t point directly to the root cause. Since it was working previously and started failing recently, I'd check a few things:
1. Verify that the target Delta table is still accessible and that there haven't been any permission or workspace changes.
2. Check whether the underlying storage account/Lakehouse is available and not experiencing connectivity issues.
3. Review the Spark/job logs around the TraceId for a more detailed exception, as PythonComputeClientException is often just a wrapper around the actual error.
4. Confirm that no schema changes were made to the Delta table recently that could cause write failures.
5. If this is running in a pipeline, try running the notebook on a fresh Spark session or restarting the compute environment.
If you can share the code used for the write operation and any additional Spark driver/executor logs associated with the TraceId, it may be easier to identify the exact cause. At the moment, the error message itself is too generic to pinpoint the issue.
Join us in Barcelona for FabCon and SQLCon, the Fabric, Power BI, SQL, and AI community event. Save €200 with code FABCMTY200.
If you love stickers, then you will definitely want to check out our community sticker challenge, Barcelona edition!
Join Data Days 2026: 60 days of free live/on-demand sessions, challenges, study groups, and certification opportunities.
| User | Count |
|---|---|
| 8 | |
| 7 | |
| 6 | |
| 4 | |
| 3 |
| User | Count |
|---|---|
| 20 | |
| 15 | |
| 15 | |
| 14 | |
| 13 |