Forum Discussion

VictorMed's avatar
VictorMed
Frequent Visitor
2 years ago
Solved

Synapse Spark mssparkutils run multiple and log analytics

Hi all,   Context: We have developed a solution using Synapse Notebooks as Fabric hasn't been approved for production yet.  The initial approach was to orchestrate each notebook using data pipeli...
  • Anonymous's avatar
    Anonymous
    2 years ago

    Hi VictorMed ,

    Thanks for using Fabric Community.
    I understand your concern about losing individual notebook monitoring with your new implementation. This is a common challenge when switching from separate orchestrations to a single spark session with mssparkutils.notebook.runtime(). While there's no direct way to capture individual notebook logs within the single session, but we have an alternative way to capture logs is - custom Logging within Notebooks

    Hope this is helpful. Please let me know incase of further queries.