Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
1 year ago
Solved

Data pipeline invocation across workspaces using variable libraries fails...

Hi,

I have a medallion architecture with bronze, silver, and gold in separate workspaces.  We have both non-prod and prod workspaces.

 

I am using the variable library and it works well within the a bronze workspace.  However, I am seeing some intermittent issues with invoking a silver pipeline from a bronze one, that has usage of the variable libraries in the notebook.  I get some interesting messages back of 401 message saying the user is not authorized.  Sometimes when I run it via the UI it succeeds and then when I schedule it, it fails at 2am when running in the context of the service principal which has been setup and configured.  

 

Anyone experienced this?  Any tips to work around?

Thanks.

3 Replies