Fabric Data Engineering plugin for VS Code exceeding pool limits

Hi Anonymous 
The error indicates that the Spark job requested more cores and memory than the allowed pool limits.
You need to adjust the Spark configurations to stay within the allowed 8-core, 56GB memory limit.

Modify the Spark Configuration in VS Code:
In your Fabric Data Engineering plugin setup within VS Code, you can manually set the appropriate Spark configurations before running queries.

Try adding the following configurations in your notebook before running queries:
**************************************************************
%%configure -f
{
"executorMemory": "4G",
"executorCores": 2,
"numExecutors": 2,
"driverMemory": "4G",
"driverCores": 2
}
**************************************************************
Restart VS Code after making the changes.
Try running a simple query first to check if the resource request is now within limits.

If the above information helps you, please give us a Kudos and marked the Accept as a solution.

Best Regards,
Community Support Team _ C Srikanth.