Forum Discussion

mmilosanovic's avatar
mmilosanovic
Advocate IV
1 year ago

Some methods in notebooks do not work when executed from Data Pipelines deployed via SPN

Hi,   I already created the ticket with Microsoft (2504161420001430) and also opened the issue here and also seems to be related to this issue here.   `notebookutils.runtime.context.get("currentW...
data engineering
Data Pipeline
Notebook
g3kuser's avatar
g3kuser
Helper II
1 year ago

we have the same issue with workspace identity as executing user. There are errors from cluster just with import statements in notebook and on applying run magic command. Even notebookutils.lakehouse.getWithProperties method also fails with 403 error. We were able to execute all of our code artefacts successfully with executing user as SPN (we generated our own SPN and added a secret to it) whereas when deploying same using workspace identity and running through it failed miserably. We even created a secret for the workspace identity and tried to use it by initializing credential class still no success. 

 

annhwallinger's avatar
annhwallinger
Helper I
1 year ago

Thank you for the detail in your response. You said you were able to run as SPN.... do you know if you were able to run these simple lines? 

 

import json
import sempy.fabric as fabric
from notebookutils import mssparkutils

#Instantiate the client
client = fabric.FabricRestClient()

# Get Workspace
workspaceId = fabric.resolve_workspace_id([workspace name here])