Forum Discussion

dbeavon3's avatar
dbeavon3
Icon for Memorable Member rankMemorable Member
10 months ago
Solved

Managing Spark Pools (Confusing, no UI, no souce control)

Where do we go to edit/manage the pools in a workspace?   The only place I can find is the funky little dropdown widget that is used for setting the default pool:     ... if you open t...
data engineering
  • tayloramy's avatar
    tayloramy
    10 months ago

    Hi dbeavon3, 

     

    You're on the correct screen, that is the place to manage pools. Not the best UI, but it works. 

     

    If you found this helpful, consider giving some Kudos. If I answered your question or solved your problem, mark this post as the solution. 

tayloramy's avatar
tayloramy
Icon for Super User rankSuper User
10 months ago

Hi dbeavon3, 

 

You're on the correct screen, that is the place to manage pools. Not the best UI, but it works. 

 

If you found this helpful, consider giving some Kudos. If I answered your question or solved your problem, mark this post as the solution. 

  • dbeavon3's avatar
    dbeavon3
    Icon for Memorable Member rankMemorable Member
    10 months ago

    So you are saying that the ONLY place to maintain Spark pools is hidden, and can only be found within a dropdown widget?  (... one that selects a "default pool" for Spark jobs). 

     

    That is insanity.

     

    Saying it is "not the best UI" is an understatement.  I think any random highschooler using winforms would build a better UI than this. I suspect that Microsoft isn't counting for serious Spark workloads to run on this platform.  (I think they make a good profit on Azure Databricks as well, and probably don't put all their eggs in one basket)