Forum Discussion

Pugtastic99_'s avatar
Pugtastic99_
Regular Visitor
1 year ago
Solved

Migrate Dataflow

How do I migrate an updated dataflow (dataverse data) from a dev workspace to a test workspace where a previous version of the dataflow already exists. Note I can't use the deployment pipeline feature as it doesn't have enough stages.

 

5 Replies

  • v-saisrao-msft's avatar
    v-saisrao-msft
    Community Support

    Hi Pugtastic99_,

    Thank you for reaching out to the Microsoft Fabric Forum Community. 

    Please review the response provided by SamsonTruong Poojara_D12  below, as it addresses your issue. It details the steps to manually migrate a dataflow, especially when Deployment Pipelines aren’t an option, including handling existing dataflows and Dataverse connections. 

    Solved: Moving dataflows from one environment to another e... - Microsoft Fabric Community 

     

    If this post helps, then please give us ‘Kudos’ and consider Accept it as a solution to help the other members find it more quickly.

     

    Thank you. 

  • Hi Pugtastic99_ ,

    Since you are unable to use deployment piplines, you can perform the migration manually. In your dev dataflow, export the dataflow as a json in the dataflow settings. Then in your test workspace, import the dataflow json to replicate it.

    If this helped, please mark it as the solution so others can benefit too. And if you found it useful, kudos are always appreciated.

    Thanks,

    Samson



  • Hi Pugtastic99_ 

    To migrate an updated dataflow (especially one sourcing from Dataverse) from a development workspace to a test workspace—where an older version of that dataflow already exists—you can manually export and import the dataflow JSON definition. Start by going to the dev workspace, select the dataflow, and choose the "Export .json" option. This exports the M code and metadata for the dataflow. Then, go to the test workspace, locate the existing dataflow, and either delete it (if a clean overwrite is acceptable) or open it for editing and replace the queries manually using the JSON. Alternatively, create a new dataflow in the test workspace and use the "Import .json" option to upload the updated definition. Make sure that any referenced parameters, linked services, or gateway connections are also configured in the test workspace to match the dev environment, especially since Dataverse connectors rely on specific environment and table mappings. Finally, once the dataflow is updated or recreated, refresh it to validate that the structure and data load as expected. This manual approach is necessary when deployment pipelines are not usable due to limited stage support (e.g., when more than dev/test/prod are required).

     

  • v-saisrao-msft's avatar
    v-saisrao-msft
    Community Support

    Hi Pugtastic99_,

    I hope you had a chance to review the solution shared earlier. If it addressed your question, please consider accepting it as the solution it helps others find answers more quickly.
    If you're still facing the issue, feel free to reply, and we’ll be happy to assist further.

     

    Thank you.

  • v-saisrao-msft's avatar
    v-saisrao-msft
    Community Support

    Hi Pugtastic99_,

    checking in to see if your issue has been resolved. If the response provided was helpful, kindly mark it as the solution so that others with the same issue can benefit.
    Please let us know if you still need assistance.

     

    Thank you.