Forum Discussion
Slow starter pool session initialization
I am currently experimenting with a F2 capacity. Whenever I try to run a notebook it takes somewhere between 2 and 2.5 minutes to start the spark cluster even though I'm using the starter pool. All s...
Hi Anonymous ,
Apologies for the issue you have been facing. We have an update from the team.
We got impacted by this limitation on supporting 1 node starter pools mainly for F2 capacity sku. Team have added this to Known Issues section in the document and the latest version should be published end of this week. We are working on a fix to enable 5 second session start experience for F2 capacity. I will update this thread once the fix is rolled out in few weeks.
Thank you
I'm also experiencing extremely slow start times (2-5 minutes) when using a custom environment. My environment uses all default spark settings; all it does is install a pip package.