topic How to programatically create a dataflow gen2 item in Data Engineering

How to programatically create a dataflow gen2 item

SriThiru — Fri, 28 Jun 2024 08:04:09 GMT

Is there any way available to programatically create an dataflow gen2 artifact in microsoft Fabric.

Please share any sample code (preferably using python in fabric notebook).

I need this automation feature to resolve various usecases.

One such example would be to automatically migrating dataflow gen 1 to dataflow gen2.

Ie., I want to perform the steps given in the following article programatically

fabric-docs/docs/data-factory/move-dataflow-gen1-to-dataflow-gen2.md at main · MicrosoftDocs/fabric-docs · GitHub

Re: How to programatically create a dataflow gen2 item

spencer_sa — Thu, 17 Oct 2024 22:28:52 GMT

There do not appear to be API entries yet for Dataflow Gen2s (nor does the artifact appear in DevOps after a synch, so no code definition in git).
(https://learn.microsoft.com/en-us/rest/api/fabric/articles/)

Re: How to programatically create a dataflow gen2 item

Anonymous — Wed, 27 Aug 2025 06:27:05 GMT

I also want to know about this scenario that if Dataflow gen2 can be created programatically as I have a use case for upcoming years data so there shoulb be some automated process like notebook which can make Dataflow gen2 automatically and attach it to the pipeline.

Re: How to programatically create a dataflow gen2 item

frithjof_v — Wed, 27 Aug 2025 06:45:06 GMT

There's an API to create Dataflow here: https://learn.microsoft.com/en-us/rest/api/fabric/dataflow/items

Semantic Link Labs has a function for creating Gen2 from Gen1:

https://semantic-link-labs.readthedocs.io/en/latest/sempy_labs.html#sempy_labs.upgrade_dataflow

I haven't tried any of these but would give it a try.