Forum Discussion

bruceOkallau's avatar
bruceOkallau
Regular Visitor
8 months ago
Solved

cannot run any spark code from notebook with starter pool and default workspace

hello, I have had the workspace upgraded a couple of times and currently on F64.   But I cannot run any spark from a notebook.   Even simply importing functions  "from pyspark.sql.functions imp...
data engineering
notebook
  • bruceOkallau's avatar
    bruceOkallau
    8 months ago

    MS support gave me the solution. I'll post it here in case it helps anyone in the future:

     

    In Admin Portal > Capactity Settings > Autoscale Billing for Apache Spark

    turn off autoscaling.

v-pnaroju-msft's avatar
v-pnaroju-msft
Community Support
8 months ago

Hi bruceOkallau,

Thank you for the update. We are pleased to hear that your issue has been resolved. Should you have any further queries, please feel free to contact the Microsoft Fabric community.

Thank you.