Data pipeline invocation across workspaces using variable libraries fails...

[dwhanger]

Hi,

I have a medallion architecture with bronze, silver, and gold in separate workspaces.  We have both non-prod and prod workspaces.

I am using the variable library and it works well within the a bronze workspace.  However, I am seeing some intermittent issues with invoking a silver pipeline from a bronze one, that has usage of the variable libraries in the notebook.  I get some interesting messages back of 401 message saying the user is not authorized.  Sometimes when I run it via the UI it succeeds and then when I schedule it, it fails at 2am when running in the context of the service principal which has been setup and configured.  

Anyone experienced this?  Any tips to work around?

Thanks.

[v-prasare · Accepted solution]

Hi @dwhanger,

Please refer to below similar solved thread from community and let me know if this helps?

https://community.fabric.microsoft.com/t5/Data-Pipeline/dynamic-library-variables/m-p/4663725/highli...

Thanks,

Prashanth Are

MS Fabric community support

[v-prasare · Accepted solution]

We would like to follow up to see if the solution provided help? let me know if you still help.

Thanks,

Prashanth Are

MS Fabric community support

[v-prasare · Accepted solution]

Hi @dwhanger,

Please refer to below similar solved thread from community and let me know if this helps?

https://community.fabric.microsoft.com/t5/Data-Pipeline/dynamic-library-variables/m-p/4663725/highli...

Thanks,

Prashanth Are

MS Fabric community support

[dwhanger]

thanks, it helps.