Fabric spark job definition parallel runs

Hi yongshao ,

Thanks for using Fabric Community.
As mentioned in docs - " Notebook utilities aren't applicable for Apache Spark job definitions (SJD). "

Unfortunately we cannot run spark jobs defined by spark job defintion in a parallel way.
At present the only way to run the Spark Job Definitions is - 

1. Run a Spark job definition manually by selecting Run from the Spark job definition item in the job list.
2. Schedule a Spark job definition by setting up a schedule plan on the Settings tab. Select Settings on the toolbar, then select Schedule.

Docs to refer -
Run an Apache Spark job definition - Microsoft Fabric | Microsoft Learn
Microsoft Spark Utilities (MSSparkUtils) for Fabric - Microsoft Fabric | Microsoft Learn

We use customer feedback like yours to prioritize future features. The more users who request the ability to customize backgrounds, the higher it moves on our list.

Appreciate if you could share the feedback on our Microsoft Fabric Ideas. Which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.

I hope this information helps. If you have any further queries please do let us know.

Thanks

Hi yongshao ,

We haven’t heard from you on the last response and was just checking back to see if your query was answered.
Otherwise, will respond back with the more details and we will try to help .

Thanks

Regarding of spark job definition, its parallel runs would boost ETL performance and scalability, hope such feature would be supported in Fabric future release