Dataflow Gen2 in deployment pipelines availability Dates

[abpgupta]

Hi All

We are still not able to deploy Gen 2 Dataflows using Deployment pipelines. This causes problem for deployment of datasets reading dataflow gen2 as well.  We have to restore to use Gen1 Dataflow and a bottleneck to adapting new technology in existing solutions.

Is there any timeline when this functionality be available?

Thanks for inputs! 

[vivien57]

Hello,

Gen2 DataFlows are now available for deployment pipelines.

I think this topic can be closed

Have a nice day

Vivien

[wanthanaj]

I saw it's been released as public review as of 31st Jan 2025. Check it out again! 🙂

[vivien57]

Hello @wanthanaj 

Thank for your message.

In fact, it's ok now

Is it possible to activate it for dataflows that have already been created?

Thank in advance for your return,

Vivien

[wanthanaj]

Hi @vivien57, I had a go yesterday. Sadly it seems like you have to recreate a new one manually (can't import from an old one). Plus, the deployment rule doesn't seem to detect any parameter used in the DF Gen2 :(. 

[Theo_MS]

HI @vivien57,

can you elaborate more?

DataFlow Gen 2 is unable to use in Deployment pipeline at this date.

Regards,

Théo

[vivien57]

Yes, normally here 

https://learn.microsoft.com/en-us/fabric/data-factory/dataflow-gen2-cicd-and-git-integration

but since this morning the window for checking the box is no longer displayed

[robert-murray]

https://learn.microsoft.com/en-us/fabric/data-factory/dataflow-gen2-cicd-and-git-integration

"Note

The release of CI/CD and Git integration support has been rescheduled to January to ensure the quality of the release and ensure that there is no impact to existing operations. We apologize for any inconvenience and appreciate your understanding."

Anyone know if that is a new "Note." We're running out of Janauary fast...

I also don't see Dataflow Gen2 in the Pipeline graphics. Am I crazy or was it there before (as "Preview")?

[vivien57]

We'll wait a few more days...

[Theo_MS]

Let us know when the option is back.

Suprisingly, feature could be remove without warning...

[Machora]

I know this has been asked before but, does anyone have an idea when Gen2 dataflows will be supported in deployment piplines? Is it in the roadmap?

[vivien57]

For the moment, I haven't seen anything about this in the roadmap.

[arpost]

@v-tianyich-msft, I have a similar question about estimated timeline for Dataflow Gen 2 support in deployment pipelines as the release plan doesn't mention anything about that support. This is a huge potential barrier to Fabric adoption if this isn't planned as it holds up or complicates any Fabric deployments that involve Gen2 dataflows.

Does the Git integration line item (set for Q4 2024) cover deployment pipeline integration?

[vivien57]

Hello,

I can't find "Data Factory Git Integration for dataflows" in the roadmap. Is this the case for you too ?

Thank in advance,

Have a nice day,

Vivien

[v-tianyich-msft]

Hi @abpgupta ,

If you would like to suggest feature improvements, you may vote the idea and comment here to improve this feature. It is a place for customers provide feedback about Microsoft Office products . What’s more, if a feedback is high voted there by other customers, it will be promising that Microsoft Product Team will take it into consideration when designing the next version in the future.

Best Regards,
Community Support Team_ Scott Chang

[abpgupta]

@v-tianyich-msft 

This is not feature improvement but it's an issue where Dataflow Gen 2 is used as source for a Dataset. With that set up, I am unable to move Dataset to next stage since Deployment Pipeline is not supporting Dataflow Gen 2 yet.