Forum Discussion

jisaac's avatar
jisaac
Icon for Helper II rankHelper II
1 year ago
Solved

Running multiple instances of the same Notebook concurrently

I have a pipeline that needs to runs two Notebook activities (A and B) before running the third Notebook activity (C). Activities A and B both run the same Notebook but with different parameters: th...
  • Anonymous's avatar
    Anonymous
    1 year ago

    Hi jisaac ,

     

    I recommend using a single call to a notebook that calls mssparkutils.notebook.runMultiple() in order to execute multiple calls to the notebook in a single Spark session. This approach allows Spark to utilize its ability to efficiently perform concurrent tasks.

     

    For more detailed information, please refer to:

    Microsoft Spark Utilities (MSSparkUtils) for Fabric - Microsoft Fabric | Microsoft Learn

     

    Best Regards,
    Yang
    Community Support Team

     

    If there is any post helps, then please consider Accept it as the solution  to help the other members find it more quickly.
    If I misunderstand your needs or you still have problems on it, please feel free to let us know. Thanks a lot!