Forum Discussion

Ryan1304's avatar
Ryan1304
Frequent Visitor
1 year ago
Solved

Spark Session Staring Issue

Hi All,    I’ve recently been experiencing significant delays when starting sessions in my notebook environment. Previously, sessions would start in under 30 seconds. However, starting from this we...
data engineering
  • BhaveshPatel's avatar
    BhaveshPatel
    1 year ago

    For faster start up times, Increases the Nodes ( Virtual Machines) and Native Execution Engine ) . If you are using small VMs ( For example F8s, F16..), This problem persists. You should use F64 capacity or more. This is equivalent to Power BI Premium P1 Capacity.

     

     

     

v-prasare's avatar
v-prasare
Community Support
1 year ago

Hi Ryan1304,

 

Can you try below troubleshooting steps and let me know if it helps?

 

 Starter Pools may take longer to warm up after periods of inactivity. If no nodes are running, startup involves provisioning VMs, which takes time. try switching to a dedicated Spark pool, even a small one, can offer more consistent and faster startup times.

Too many simultaneous sessions starts, pipeline triggers, or data refreshes can congest your capacity. Disable High Concurrency mode temporarily to see if startup improves

navigate to the Admin Portal and selecting Capacity settings, then go to the Monitor section and open Capacity metrics. check key indicators such as CPU and memory pressure, queue length, and overall resource utilization trends. Pay close attention to any signs of throttling or job queuing, which may indicate that your capacity is under strain or experiencing contention, leading to delays in notebook session startup

 

 

 

 

 

Thanks,

Prashanth Are

MS Fabric community

 

If this solution works, please consider marking it as Accept as Solution, this will help other community members easily find answers to similar issues.