Forum Discussion
Gen2 dataflows and deployment pipelines
- 1 year ago
Hi mikesmall
As of now, Gen2 dataflows (Dataflows Gen2) are not yet fully supported in Power BI Deployment Pipelines, which is likely why you're not seeing them show up in your pipeline environments during testing. Deployment pipelines currently focus on semantic models, reports, and dashboards, and do not automatically include Gen2 dataflows—especially those not tied to a specific destination like a Lakehouse or Warehouse. Since Gen2 dataflows rely on Microsoft Fabric's OneLake infrastructure, their integration with deployment pipelines is still evolving and subject to future roadmap updates.
Furthermore, Gen2 dataflows often require a staging destination (usually a Lakehouse or Warehouse) to properly materialize and store their output, which is not just a convenience—it's essential for how they function and persist data. If you left the destination unset for simplicity, the dataflow wouldn't create or associate with any deployable artifact (like a Lakehouse table), meaning there's nothing concrete for the pipeline to pick up or compare across environments.
In practice, if you're testing Gen2 dataflows and want to prepare for future deployment pipeline integration, it's recommended to assign an explicit destination (e.g., a Lakehouse in your Fabric workspace). Also, monitor the Fabric release roadmap or official Microsoft documentation closely, as support for deploying Gen2 dataflows through pipelines is a highly requested feature and may be included in future updates.
In the meantime, deployment of Gen2 dataflows across environments typically needs to be done manually (e.g., exporting and importing definitions), or automated using APIs or Fabric CLI once such tools support the feature.
As of June 2024, Gen2 data flows are still not supported in deployment pipelines. I also cannot find a mention on any roadmap.
Can anyone confirm when this feature is expected? We cannot take a system into production that uses Gen2 flows without deployment pipeline support.
Thanks!
Second this - could not recommend moving to production until there is full support for deployment (one way or another) for DFG2.
- cwilce2 years agoRegular Visitor
Just adding this from reddit where the same question was asked https://www.reddit.com/r/MicrosoftFabric/comments/1dogga0/dataflows_gen2_with_deployment_pipelines/
TLDR: Gen2 Dataflows with Deployment Pipelines isn't in the current roadmap which goes up until October. Check back then to get the next 6 month roadmap (which will hopefully have this feature included!).
- mikesmall2 years agoAdvocate I
I was in some Microsoft Azure training on Tuesday and asked the question, the confirmed it was not possible and there was no timeline. Seems to be a massive oversight and a real barrier in moving to Fabric.