topic Re: Centralized Notebooks to be called by Pipelines in Pipelines

Centralized Notebooks to be called by Pipelines

daniele_tiles — Fri, 07 Jun 2024 09:37:05 GMT

Hi to all,

we're studying how to call Notebook through Pipelines with parameters. From what I've understood, at the moment isn't possible to call a Notebook stored in a Workspace A from a pipeline stored in another Workspace.

I think that it'd be very interesting and useful to have the possibility to call Notebooks from another Workspace: we would be able to create a "centralized logic", IT driven for example, on how to use some standard code for processing data, and by passing some parameters (source, destination, some other metadata) having that working for different scenarios. So one notebook for many use cases, without duplication of code (in order to have a stronger ETL process)

Is something like that already on road-map?

Best regads

Daniele Tiles

Re: Centralized Notebooks to be called by Pipelines

NandanHegde — Fri, 07 Jun 2024 10:36:16 GMT

Not sure whether you have tried but you can parameterize and call the notebooks cross workspace is my understanding

Re: Centralized Notebooks to be called by Pipelines

daniele_tiles — Fri, 07 Jun 2024 10:44:34 GMT

Hi NandanHegde ,

no, I haven't yet tried it! Did you try it, does it work with a notebook on a different workspace?

Thanks

Daniele