Forum Discussion
Geeting error while overwrite the data in delta table
Hi, Udaysutar28apr
Regarding the issue you raised, my solution is as follows:
1.Firstly, based on your error message, the most straightforward explanation may be that the file does not exist. Therefore, please ensure that the file path specified in your code is correct and that the file is indeed present at that location.
2.Next, check whether you have sufficient permissions to access and modify the Delta table. Ensure that your Spark job has the appropriate access rights.
3.Finally, if you are using Microsoft Fabric, make sure that the DirectLake feature is enabled. This can be configured after creating a report in Power BI and may resolve any connection issues with the Delta table.
Here are some links related to similar issues you may find helpful:
Solved: Issue with Delta Table Overwrite in Lakehouse Once... - Microsoft Fabric Community
Of course, if you have any new discoveries or questions, please feel free to get in touch with us.
Best Regards,
Leroy Lu
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
I have all permisions. I'm overwiting data frequently in delta table. sometime working fine but some time failure due to 404 error . Please suggest how to proceed with this .
Hi, Udaysutar28apr
Thank you for your prompt response.
If this is a temporary issue, we cannot rule out the possibility that it may be caused by network latency, as all changes made on the service require network transmission for updates.
Of course, you might also consider employing a controlled variable approach to document the reasons behind the occasional successes.
Best Regards,
Leroy Lu
No i dont think continous network issue is there .I'm executing pipeline every 10 minutes and every hour's we are getting 3-4 failure out of 6 runs. lets take look on this , Please suggest how overcome this.
