topic Re: Spark Session Start Up Time in Data Engineering

Spark Session Start Up Time

higgy7 — Tue, 09 Sep 2025 09:52:41 GMT

My spark session startup times are now taking 10-15 minutes to start even when i am using the starter pool. Now i did go in and reduce the number of dynamically allocated executors. But even when i put this back to default the sessions is taking an age to begin. Is this normally behaviour? I thought the starter pool should begin in seconds.

Re: Spark Session Start Up Time

wardy912 — Tue, 09 Sep 2025 10:07:06 GMT

Hi @higgy7

I'm currently having spark issues to, there is an active incident that is affecting start times

Microsoft Fabric Known Issues

--------------------------------

I hope this helps, please give kudos and mark as solved if it does!

Connect with me on LinkedIn.

Subscribe to my YouTube channel for Fabric/Power Platform related content!

Re: Spark Session Start Up Time

higgy7 — Tue, 09 Sep 2025 10:24:14 GMT

Thanks, does this apply to the default starter pool as well though?

Re: Spark Session Start Up Time

wardy912 — Tue, 09 Sep 2025 10:26:52 GMT

I believe so, as we are using starter pools and have been experiencing slow start ups since yesterday with no other explanation.