Forum Discussion
Synapse Spark mssparkutils run multiple and log analytics
Hi VictorMed ,
Thanks for using Fabric Community.
I understand your concern about losing individual notebook monitoring with your new implementation. This is a common challenge when switching from separate orchestrations to a single spark session with mssparkutils.notebook.runtime(). While there's no direct way to capture individual notebook logs within the single session, but we have an alternative way to capture logs is - custom Logging within Notebooks
Hope this is helpful. Please let me know incase of further queries.
Hi VictorMed ,
Thanks for using Fabric Community.
I understand your concern about losing individual notebook monitoring with your new implementation. This is a common challenge when switching from separate orchestrations to a single spark session with mssparkutils.notebook.runtime(). While there's no direct way to capture individual notebook logs within the single session, but we have an alternative way to capture logs is - custom Logging within Notebooks
Hope this is helpful. Please let me know incase of further queries.
Hi VictorMed ,
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet .
In case if you have any resolution please do share that same with the community as it can be helpful to others .
Otherwise, will respond back with the more details and we will try to help .Hi Anonymous
Thank you for your answer and the information provided.
We'll discuss it internally and give it a go, we were trying to find a solution that wouldn't need to maintain customized logging, but it seems it's the only way right now.
Regards,
Victor
Hi VictorMed ,
Glad to know that your query got answered.
Please continue using Fabric Community for your further queries.
