Forum Discussion

bruceOkallau's avatar
bruceOkallau
Regular Visitor
7 months ago
Solved

cannot run any spark code from notebook with starter pool and default workspace

hello, I have had the workspace upgraded a couple of times and currently on F64.   But I cannot run any spark from a notebook.   Even simply importing functions  "from pyspark.sql.functions imp...
  • bruceOkallau's avatar
    7 months ago

    MS support gave me the solution. I'll post it here in case it helps anyone in the future:

     

    In Admin Portal > Capactity Settings > Autoscale Billing for Apache Spark

    turn off autoscaling.