Forum Discussion
Shared Sessions are taking longer to get attached while executing notebook in pipeline run in fabric
The screenshots show increased attach times for shared spark sessions in fabric pipelines esp., at the start and end notebook activities. This slowdown is likely due to backend resource contention/session reuse delays within the shared spark pool. When multiple notebooks run concurrently or capacity is under load, session warmup and context switch times may increase.
actions that you can try:
Monitor fabric capacity metrics (CPU, memory, spark concurrency).
Try assigning a dedicated spark session per pipeline or using “Run in new session” for critical notebooks.
Clear idle sessions periodically using the fabric REST API or capacity admin tools.
Raise a fabric support ticket with timestamps for correlation as this might be a transient backend performance regression.
Super UserThe screenshots show increased attach times for shared spark sessions in fabric pipelines esp., at the start and end notebook activities. This slowdown is likely due to backend resource contention/session reuse delays within the shared spark pool. When multiple notebooks run concurrently or capacity is under load, session warmup and context switch times may increase.
actions that you can try:
Monitor fabric capacity metrics (CPU, memory, spark concurrency).
Try assigning a dedicated spark session per pipeline or using “Run in new session” for critical notebooks.
Clear idle sessions periodically using the fabric REST API or capacity admin tools.
Raise a fabric support ticket with timestamps for correlation as this might be a transient backend performance regression.