Forum Discussion
Notebook activity in the Fabric pipeline, using Service Principal resulting in error
Community SupportHi bkhan2,
Thank you Lodha_Jaydeep, for your insights.
The failure happens during notebook execution when Fabric attempts to create a Spark (Livy) session. Microsoft documentation states that the Livy API used for Spark execution currently does not support Service Principals, which may cause failures if a Service Principal is used. Even with the correct permissions, this is a platform limitation, not a configuration problem. As a workaround, you can run the notebook activity with a user identity or Workspace Identity, or use a hybrid method where only the notebook operates under a user identity.
Submit Spark batch jobs using the Livy API - Microsoft Fabric | Microsoft Learn
Notebook activity - Microsoft Fabric | Microsoft Learn
Thank you.
Thanks v-saisrao-msft
I am getting the same error even with the Worksapce Identity.The Worksapce Identity have Contributor access to the workspace containing the pipeline and the notebook. Worksapce Identity is also allowed to call Fabric public APIs.
Can you please try removing the connection completely in the notebook activity?
