Forum Discussion
[TooManyRequestsForCapacity] This spark job can't be run because you have hit a spark compute or API
Hello, I'm getting the below error when I try to run the two notebooks parallelly. This is the first notebook running with Standard Session When I try to run the other notebook, i'm getting...
FabianSchut
Solution Sage
Solution SageYou could try to decrease the Spark Compute for the entire workspace in these settings:
https://learn.microsoft.com/en-us/fabric/data-engineering/create-custom-spark-pools.
When you switch to a small node size and disable autoscale and set a fixed number of executors, you could try to find the best configuration to run your two notebooks while still running your code within reasonable time.
Instead of doing this for the whole workspace, you could also create a custom environment and set your notebooks to that environment. You find the documentation for the custom environment here: https://learn.microsoft.com/en-us/fabric/data-engineering/create-and-use-environment