Forum Discussion
Permissions Issues When Running Spark Notebook Within a Data Pipeline
I am configuring a data pipeline within a fabric workspace. As part of this pipeline I need to run a spark notebook in a for each loop over a given parameter list.
When I try to run the pipeline, I'm getting an error saying that "The caller does not have sufficient permissions to access the requested resource". The error message then gives the workspace id in reference to the specific resource for which the caller doesn't have permissions. I'm assuming here that I am the caller in this situation. I am an admin on this workspace. I configured the notebook connection to use the workspace identity.
I have ownership of the notebook. The notebook runs fine outside of the pipeline.
Just in case it has an impact, technically my account is part of a group and that group is an admin on the workspace.
I haven't had any permissions issues with any other action on this workspace.
Thank you all for your help with this matter.
Hi TazmanLibson,
In the notebook activity, are you defining a connection?
Also, is your account the owner of the pipeline object itself?If no connection is configured, then Fabric will automatically use the identity of the pipeline owner.
4 Replies
Hello. I have done some more research and I believe the problem is with my workspace identity. My workspace has a workspace identity, but under "role" it doens't say any role. I am having issues finding where I can edit the workspace identity. Everything I have found says that you can do it in the admin portal but when I go to it, there isn't any option to edit workspace identities.
- tayloramy
Super User
Have you added the WI to your workspace in the manage access tab? That is how you grant workspace permissions to it, you can add it as an admin.
- tayloramy
Hi TazmanLibson,
In the notebook activity, are you defining a connection?
Also, is your account the owner of the pipeline object itself?If no connection is configured, then Fabric will automatically use the identity of the pipeline owner.
Hello,
I made myself the owner of the pipeline object and removed the connection and I was able to run the notebook within the pipeline.
Thank you
