topic Re: Data pipeline invocation across workspaces using variable libraries fails... in Pipelines

Data pipeline invocation across workspaces using variable libraries fails...

Anonymous — Thu, 24 Jul 2025 23:44:07 GMT

Hi,

I have a medallion architecture with bronze, silver, and gold in separate workspaces. We have both non-prod and prod workspaces.

I am using the variable library and it works well within the a bronze workspace. However, I am seeing some intermittent issues with invoking a silver pipeline from a bronze one, that has usage of the variable libraries in the notebook. I get some interesting messages back of 401 message saying the user is not authorized. Sometimes when I run it via the UI it succeeds and then when I schedule it, it fails at 2am when running in the context of the service principal which has been setup and configured.

Anyone experienced this? Any tips to work around?

Thanks.

Re: Data pipeline invocation across workspaces using variable libraries fails...

v-prasare — Fri, 25 Jul 2025 17:17:28 GMT

Hi Anonymous,

Please refer to below similar solved thread from community and let me know if this helps?

https://community.fabric.microsoft.com/t5/Data-Pipeline/dynamic-library-variables/m-p/4663725/highli...

Thanks,

Prashanth Are

MS Fabric community support

Re: Data pipeline invocation across workspaces using variable libraries fails...

v-prasare — Mon, 28 Jul 2025 18:36:02 GMT

We would like to follow up to see if the solution provided help? let me know if you still help.

Thanks,

Prashanth Are

MS Fabric community support

Re: Data pipeline invocation across workspaces using variable libraries fails...

Anonymous — Tue, 19 Aug 2025 22:40:58 GMT

thanks, it helps.