Forum Discussion

nerminyehia's avatar
nerminyehia
Frequent Visitor
10 months ago
Solved

Fabric Python Notebook Execution Logs

Hey,   I created a Python notebook to install and run dbt code, but when I call it from the pipeline, I can not get the execution logs and get stuck in the loading state.       Tha...
Need Help
Tips and Tricks
  • nerminyehia's avatar
    nerminyehia
    10 months ago

    Thanks for your help. It works after allowing the high concurrency feature.

nerminyehia's avatar
nerminyehia
Frequent Visitor
10 months ago

Hey,

 

Thank you so much for the suggestion. But I don't think it is related to the notebook content, because I tried to run an empty notebook with one print statement, but it keeps getting the same issue. I need to see the notebook run details whenever it is triggered by the pipeline.

 

 

v-saisrao-msft's avatar
v-saisrao-msft
Icon for Community Support rankCommunity Support
10 months ago

Hi nerminyehia,

The notebook might seem stuck because every notebook run through a pipeline needs a Spark session to start, even if it’s empty. To check what’s happening and see the logs, you can go to Run → All Runs and use the Related Notebook tab in the monitoring view. Turning on High Concurrency mode for pipelines helps notebooks share sessions more efficiently and makes sure the logs are visible while they run.

Configure high concurrency mode for notebooks in pipelines - Microsoft Fabric | Microsoft Learn

Configure high concurrency mode for notebooks - Microsoft Fabric | Microsoft Learn

 

Thank you.