topic Re: clone dataflow in Data Engineering

clone dataflow

arkiboys2 — Sun, 27 Oct 2024 07:44:33 GMT

in the fabric dataflowgen2 how is it possible to create a copy of the dataflow?

in the settings of the dataflow, I do not see an option for clone.

thanks

Re: clone dataflow

Expiscornovus — Sun, 27 Oct 2024 07:54:25 GMT

Hi @arkiboys2,

As a workaround you can try REST API and PowerShell.

Here is an example on StackOverflow: https://stackoverflow.com/questions/75871100/clone-power-bi-dataflow-from-to-another-workspace

Re: clone dataflow

frithjof_v — Sun, 03 Nov 2024 09:30:40 GMT

For Dataflows Gen2:

You will need to export as a Power Query Template (.pqt) and import template into a new Dataflow Gen2.

I think this has to be done manually, because Dataflow Gen2 does not have any of API, Git integration or deployment pipelines yet.

There is also no option to Save As or Copy an entire Dataflow Gen2.

Re: clone dataflow

Anonymous — Mon, 28 Oct 2024 07:20:16 GMT

Hi @arkiboys2 ,

Thanks for the reply from Expiscornovus / frithjof_v .

Trying to replicate Dataflow Gen2 in Fabric cannot be done directly through the settings. However, you can use the Quick Copy feature to achieve a similar result. The specific method is as follows:

In Dataflow's Power Query editor, select the “Options” button, go to the “Scale” tab, and turn on the “Allow use of fast replication connectors ” checkbox.
Select the data source and fill in the details. Use the Merge Files feature to ingest data.
Using this method allows ingesting and transforming data at scale and is an alternative.

For more detailed information, please refer to:

Fast copy in Dataflows Gen2 - Microsoft Fabric | Microsoft Learn

Best Regards,
Yang
Community Support Team

If there is any post helps, then please consider Accept it as the solution to help the other members find it more quickly.
If I misunderstand your needs or you still have problems on it, please feel free to let us know. Thanks a lot!

Re: clone dataflow

Anonymous — Fri, 01 Nov 2024 07:22:26 GMT

Hi @arkiboys2 ,

Is my follow-up just to ask if the problem has been solved?

If so, can you accept the correct answer as a solution or share your solution to help other members find it faster?

Thank you very much for your cooperation!

Best Regards,
Yang
Community Support Team