How to Dynamically Change Dataflow Gen2 Destination During CI/CD Deployment Between Workspaces?

[carlo-spring]

Hi everyone,

Does anyone know how to dynamically change the destination of a Dataflow Gen2 (CI/CD) when deploying it from one workspace to another (e.g., from DEV to UAT or PRO)?

I frequently use Dataflow Gen2 with Git integration, and the biggest issue I’m facing is that every time I deploy a dataflow to a different workspace (UAT or PRO), I have to manually go into each dataflow and change its destination (usually a Warehouse) so it points to the correct workspace environment.

This becomes very inefficient and error-prone, especially when managing many dataflows across environments.

Is there a way to automate this destination switch during CI/CD deployment, maybe through environment variables, scripting, or some feature I might be missing?

Thanks in advance!

[miguel]

We're working on multiple solutions for this. At the moment you are correct that you have to make the changes in each of the stages.