Forum Discussion

priyankabis's avatar
priyankabis
Helper I
1 year ago
Solved

Run notebooks in parallel

Hi team   I want to run notebooks in parallel. But i see that the time it takes to run them through pipeline is longer than the time taken to run individually. Is there a setting that needs to be d...
Pipelines
priyankabis's avatar
priyankabis
Helper I
1 year ago

Hi

 

I dont think this documentationi s right for Fabric. This documentation is for Databricks

 

Anonymous's avatar
Anonymous
Not applicable
1 year ago

Hi priyankabis ,

I'm sorry this official documentation above didn't help you, but I think you can enable high concurrency mode. This mode allows multiple notebooks to share a Spark session.

1. Navigate to the Data Engineer/Science section.
2. Select the Spark Compute menu.
3. If the High Concurrency Mode option is disabled, enable the High Concurrency Mode option.

 

You can also look at this link: Introducing High Concurrency Mode in Notebooks for Data Engineering and Data Science workloads in Microsoft Fabric | Microsoft Fabric Blog | Microsoft Fabric

 

 

 

Best Regards

Yilong Zhou

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.