Forum Discussion

KUMARCH's avatar
KUMARCH
Regular Visitor
5 months ago
Solved

PYSPARK notebook issue

I am using Microsoft Fabric Trial. Issue: PySpark notebooks are not connecting Every notebook shows: "Your compute session was disconnected" Getting HTTP 430 TooManyRequestsForCapacity ...
workspaces
  • tayloramy's avatar
    tayloramy
    5 months ago

    Hi KUMARCH, 

     

    The default spark pools are too big for an F4 trial capacity. 
    Go into your workspace settings and create a new pool with a small node size and 0 autoscale, and you should be able to run your notebooks.  

arabalca's avatar
arabalca
Icon for Super User rankSuper User
5 months ago

Hi KUMARCH ,

 I ran into the same error today and thought of you.

In my case, I adjusted the Spark configuration. I had a Medium node running on an F4 capacity, and I changed it to Small, also adjusting the number of nodes. Give it a try and let us know if it works for you:

https://learn.microsoft.com/en-us/fabric/data-engineering/environment-manage-compute

 

If this response has been helpful, please don't forget to give it a Like and mark it as a Solution so other community members can find it easily.

 

Thank you!

 

  • KUMARCH's avatar
    KUMARCH
    Regular Visitor
    5 months ago
    Thank you so Much

    I created a new pool with a small after that, the notebook is working now