Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
2 years ago

Slow starter pool session initialization

I am currently experimenting with a F2 capacity. Whenever I try to run a notebook it takes somewhere between 2 and 2.5 minutes to start the spark cluster even though I'm using the starter pool. All s...
admin
data engineering
Anonymous's avatar
Anonymous
Not applicable
2 years ago

Hi Anonymous ,

Apologies for the issue you have been facing. We have an update from the team.
 We got impacted by this limitation on supporting 1 node starter pools mainly for F2 capacity sku. Team have added this to Known Issues section in the document and the latest version should be published end of this week. We are working on a fix to enable 5 second session start experience for F2 capacity. I will update this thread once the fix is rolled out in few weeks.

Thank you

cheresier's avatar
cheresier
Frequent Visitor
2 years ago

Anonymous , has the fix been implemented? It has been ~8 weeks since you said that the fix would be "rolled out in few weeks" and I am still seeing slow startup times on the F2 capacity.

 

Thanks

  • Anonymous's avatar
    Anonymous
    Not applicable
    2 years ago

    Hi cheresier ,

    We are reaching out to the internal team to get more information related to your query and will get back to you as soon as we have an update.

    • Anonymous's avatar
      Anonymous
      Not applicable
      2 years ago

      Now there's been another two weeks. Any update on this? Many thanks!

      • Anonymous's avatar
        Anonymous
        Not applicable
        2 years ago

        Hi Anonymous ,

        No not yet. We have a deployment freeze in December and this is still being worked on. Team is  targeting by Q1 for this to be rolled out to all prod regions. Will update this thread once the support for smaller capacities is enabled.