Forum Discussion
Synapse Spark mssparkutils run multiple and log analytics
Hi VictorMed ,
Thanks for using Fabric Community.
I understand your concern about losing individual notebook monitoring with your new implementation. This is a common challenge when switching from separate orchestrations to a single spark session with mssparkutils.notebook.runtime(). While there's no direct way to capture individual notebook logs within the single session, but we have an alternative way to capture logs is - custom Logging within Notebooks
Hope this is helpful. Please let me know incase of further queries.
Hi VictorMed ,
Thanks for using Fabric Community.
I understand your concern about losing individual notebook monitoring with your new implementation. This is a common challenge when switching from separate orchestrations to a single spark session with mssparkutils.notebook.runtime(). While there's no direct way to capture individual notebook logs within the single session, but we have an alternative way to capture logs is - custom Logging within Notebooks
Hope this is helpful. Please let me know incase of further queries.
Hi Anonymous
Thank you for your answer and the information provided.
We'll discuss it internally and give it a go, we were trying to find a solution that wouldn't need to maintain customized logging, but it seems it's the only way right now.
Regards,
Victor
Hi VictorMed ,
Glad to know that your query got answered.
Please continue using Fabric Community for your further queries.