Forum Discussion
Error: PipelineException: Container exited unexpectedly with code 0x0000DEAD
Hi,
According to your error description, you can try the below suggestions:
There is a semantic difference when the entities are referenced from DF in the same workspace vs DF is a different workspace with respect to the compute engine. In the same workspace case, the dataflows have a strong reference to each other and are updated in the same transaction. Hence we do not need to cache data and can refer to the data from the upstream entity. However, when they come from the different workspaces, the references are weak references and in order to be self-contained within a workspace, we do need to re-cache the data. The re-caching step is what adds additional time in processing.
To mitigate this we suggest
- Increase dataflows’ max memory % and decrease the Datasets max memory % by the same quantity. (If they have default settings then increase dataflows to 40% and decrease Datasets to 80%)
- Increase Dataflows container size to 1500Mb. This will reduce parallelism and potentially reduce intermittent failures.
Here’s a blog to troubleshoot the dataflow refresh, you can check:
Thank you very much!
Best Regards,
Community Support Team _Robert Qin
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.