topic data pipelines and notebook to new workspace in Pipelines

data pipelines and notebook to new workspace

Mathan1787 — Fri, 18 Aug 2023 08:27:32 GMT

Hi,

I have two workspace- one for development and another for production. I have loaded data into lakehouse in development using copy activity and did further transformation using Notebooks. I was to migrate these pipelines and notebooks to production. How can i use parameter to change source DB from dev to production?

Re: data pipelines and notebook to new workspace

ajarora — Fri, 18 Aug 2023 17:44:14 GMT

Currently you can create 2 separate connections, one for dev and one for production.

But there is scope to improve this experience in future, by allowing database name to be provided dynamically through the copy activity, so that the same connection can be reused in dev and prod workspace, but db names can be overridden by the pipeline. cc Anonymous

Re: data pipelines and notebook to new workspace

GraceGu — Mon, 21 Aug 2023 06:01:12 GMT

Would you help vote Fabric Idea: onnections should be parameterized to allow for connections across multiple similar connection types for this need? For us to priortize.

Re: data pipelines and notebook to new workspace

Mathan1787 — Mon, 21 Aug 2023 07:02:53 GMT

but how can i copy transfer the pipelines and notebook from my development workspace to production workspace.

Re: data pipelines and notebook to new workspace

ajarora — Mon, 21 Aug 2023 17:23:06 GMT

We are working on CICD solution that will allow this transfer. Until then you will need to copy the pipelines yourselves by manually recreating them in target workspace.