Forum Discussion
Advocate IVDataflow gen2 in deployment pipelines
Your feedback is extremely valuable and highlights a key area for improvement. as Microsoft's official support for for pipeline orchestration support with CI/CD-enabled Dataflow Gen2 is limited we recommend to submit your ideas here to Fabric team: https://ideas.fabric.microsoft.com/ideas/search-ideas/
as feedback given here will closely monitored by PG team. We are committed to ensuring our solutions meet your business needs and workflows effectively. Thank you for your patience and understanding as we work to enhance this functionality.
Community SupportTo enable CI/CD and Git integration for your existing Dataflow Gen2 items, you will need to recreate them with the integration enabled. This involves creating a new Dataflow Gen2, enabling Git integration during its creation, and then replicating the configurations and dataflows from your existing dataflow into the new one. Once this process is complete, the new dataflow will support CI/CD and Git integration.
Thanks,
Prashanth Are
MS Fabric community support
Advocate IVThanks v-prasare for the response. I have started recreating the dataflow gen2 with enabled Git integration. However, I have hit a major blocker since it seems the data pipelines won't be able to add these new dataflows for orchestration. So it is of no use to me even if I recreate, unless I can use them in a data pipeline activity, which the the main orchestration process I am using. Is there a workaround for this?
- Orchestrating a refresh of a Dataflow Gen2 with CI/CD and Git support isn't possible in Fabric data pipelines.
We just ran into the same problem. Major roadblock for our Fabric ETL implementation. We may need to consider abandoning Dataflow Gen2 and use notebooks. Anyone else having the same problem?
BYW --> the term Fabric data pipelines and deployment pipelines are very similar which is causing a lot of confusion in posts and discussions
- v-prasare
Your feedback is extremely valuable and highlights a key area for improvement. as Microsoft's official support for for pipeline orchestration support with CI/CD-enabled Dataflow Gen2 is limited we recommend to submit your ideas here to Fabric team: https://ideas.fabric.microsoft.com/ideas/search-ideas/
as feedback given here will closely monitored by PG team. We are committed to ensuring our solutions meet your business needs and workflows effectively. Thank you for your patience and understanding as we work to enhance this functionality.
