Forum Discussion

DiKi-I's avatar
DiKi-I
Post Partisan
1 year ago
Solved

Deploy dataflow gen2 using deployment pipeline

How to migrate the dataflow between multiple stages dev test and prod using deployment Pipeline. The dataflow is connected to lakehouse and datawarehouse. Could you some one please help on this?
  • v-pnaroju-msft's avatar
    1 year ago

    Thankyou, MasonMA, for your response.

    Hi DiKi-I,

    We appreciate your question posted on the Microsoft Fabric Community Forum.

    From what I understand, right now Dataflow Gen2 does not automatically update its Lakehouse or Data Warehouse connections when you deploy it. This creates some difficulties while moving across different environments because you need to change the connections manually.

    Please follow these steps that might help solve the problem:

    1. Create three separate Fabric workspaces named Dev, Test, and Prod.
    2. Go to Deployment Pipelines in Fabric. Create a new pipeline and assign the Dev workspace to Stage 1. Then link the Test and Prod workspaces to the next stages.
    3. After setting up the pipeline, the Dataflow Gen2 will show up as an artifact. Click on Deploy to Test, and then Deploy to Prod. After deployment, update the Lakehouse or Data Warehouse connections manually in each stage.

    Also, please check these links for more information:
    The Microsoft Fabric deployment pipelines process - Microsoft Fabric | Microsoft Learn
    Dataflow Gen2 with CI/CD and Git integration - Microsoft Fabric | Microsoft Learn
    Overview of Fabric deployment pipelines - Microsoft Fabric | Microsoft Learn

    If you find this response helpful, please mark it as the accepted solution and give kudos. This will help other community members who may have the same question.

    If you have any more questions, feel free to reach out to the Microsoft Fabric community.

    Thank you.