Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Join us for an expert-led overview of the tools and concepts you'll need to become a Certified Power BI Data Analyst and pass exam PL-300. Register now.

Reply
Udaysutar28apr
Microsoft Employee
Microsoft Employee

Geeting error while overwrite the data in delta table

In fabric notebook I'm overwriting data in delta table but now getting error :

Please help me to fix this error

org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 255.0 failed 4 times, most recent failure: Lost task 0.3 in stage 255.0 (TID 3314) (vm-e7066017 executor 1): org.apache.spark.SparkFileNotFoundException: Operation failed: "Not Found", 404, HEAD,

4 REPLIES 4
Anonymous
Not applicable

Hi, @Udaysutar28apr 
Regarding the issue you raised, my solution is as follows:

1.Firstly, based on your error message, the most straightforward explanation may be that the file does not exist. Therefore, please ensure that the file path specified in your code is correct and that the file is indeed present at that location.

 

2.Next, check whether you have sufficient permissions to access and modify the Delta table. Ensure that your Spark job has the appropriate access rights.

 

vlinyulumsft_0-1731998979213.png

 

 

vlinyulumsft_1-1731998979215.png

3.Finally, if you are using Microsoft Fabric, make sure that the DirectLake feature is enabled. This can be configured after creating a report in Power BI and may resolve any connection issues with the Delta table.

vlinyulumsft_2-1731999019774.png

 

 

vlinyulumsft_3-1731999019776.png

 

Here are some links related to similar issues you may find helpful:

 Solved: Issue with Delta Table Overwrite in Lakehouse Once... - Microsoft Fabric Community
Of course, if you have any new discoveries or questions, please feel free to get in touch with us.
 

Best Regards,

Leroy Lu

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

 

I have all permisions. I'm overwiting data frequently in delta table. sometime working fine but some time failure due to 404 error . Please suggest how to proceed with this .

Anonymous
Not applicable

Hi, @Udaysutar28apr 

Thank you for your prompt response.

 

If this is a temporary issue, we cannot rule out the possibility that it may be caused by network latency, as all changes made on the service require network transmission for updates.

 

Of course, you might also consider employing a controlled variable approach to document the reasons behind the occasional successes. 

 

Best Regards,

Leroy Lu

 

No i dont think continous network issue is there .I'm executing pipeline every 10 minutes and every hour's we are getting 3-4 failure out of 6 runs. lets take look on this , Please suggest how overcome this.

Helpful resources

Announcements
Join our Fabric User Panel

Join our Fabric User Panel

This is your chance to engage directly with the engineering team behind Fabric and Power BI. Share your experiences and shape the future.

June 2025 Power BI Update Carousel

Power BI Monthly Update - June 2025

Check out the June 2025 Power BI update to learn about new features.

June 2025 community update carousel

Fabric Community Update - June 2025

Find out what's new and trending in the Fabric community.