Forum Discussion

FelixL's avatar
FelixL
Advocate II
1 year ago
Solved

Delta ConcurrentAppendException when loading different tables in Lakehouse, but at the same time

I am facing an issue when running multiple concurrent loads into a Fabric Lakehouse, that doesnt really make sense to me. I have developed a PySpark framework for running my loasds in parallell, util...
data engineering
Lakehouse
Notebook
Spark Job Definition
  • FelixL's avatar
    FelixL
    1 year ago

    I am an idiot. After further debugging i found the issue, and it was all on my side. So Fabric/Lakehouse works as intended in this case. Thank you for helping me, and sorry for wasting your time. :'( 

     

    (the conflict appears in a shared/log table, that I did not think of being a potential culprit..)

V-yubandi-msft's avatar
V-yubandi-msft
Community Support
1 year ago

Hi FelixL ,

 

nilendraFabric , has provided an exact solution to your issue. Could you kindly confirm whether your problem has been resolved or if you are still encountering any difficulties? Your feedback is valuable to the community as it assists others who might face a similar issue.

Thank you, nilendraFabric , for your valuable insights.

 

If the issue is resolved, please mark it As the Accepted solution to help others in the community find the answer more easily.

 

Regards,

Yugandhar.