Forum Discussion
Ms Fabric spark notebook with poor performance
I have a notebook that was running on a Databricks cluster with only 4 executor cores and 4 driver cores, and Autoscale and Dynamically allocate executors were disabled. Here, the notebook executed i...
It seems like the Autoscale and Dynamic Allocation settings in Fabric might be over-allocating resources, which could be slowing things down. Try adjusting those settings to better match your workload, or consider disabling Autoscale and Dynamically allocating executors to match the Databricks setup. You could also experiment with manually adjusting the number of cores to see if that helps improve performance.