Forum Discussion
Solved
cannot run any spark code from notebook with starter pool and default workspace
hello, I have had the workspace upgraded a couple of times and currently on F64. But I cannot run any spark from a notebook. Even simply importing functions "from pyspark.sql.functions imp...
MS support gave me the solution. I'll post it here in case it helps anyone in the future:
In Admin Portal > Capactity Settings > Autoscale Billing for Apache Spark
turn off autoscaling.
MS support gave me the solution. I'll post it here in case it helps anyone in the future:
In Admin Portal > Capactity Settings > Autoscale Billing for Apache Spark
turn off autoscaling.