Forum Discussion
Advocate IVDataflow gen2 in deployment pipelines
Your feedback is extremely valuable and highlights a key area for improvement. as Microsoft's official support for for pipeline orchestration support with CI/CD-enabled Dataflow Gen2 is limited we recommend to submit your ideas here to Fabric team: https://ideas.fabric.microsoft.com/ideas/search-ideas/
as feedback given here will closely monitored by PG team. We are committed to ensuring our solutions meet your business needs and workflows effectively. Thank you for your patience and understanding as we work to enhance this functionality.
Advocate IVThank you for the response. We are already at the end of January, hope to get the release/update in a couple of days now.
Also, I do not see the option below too
Once the CICD is enabled, and once we are able to use the dataflow gen2 in a deployment pipeline, I hope that it will support existing dataflow gen2 as well, and not just the ones newly created with this checkbox?
Community SupportGpop13, Thanks for your valuable insights and feedback.
I will closely monitor updates on its integration and inform you as soon as I receive any new information. meanwhile, I request you to submit your feedback here in documentation. so, that product team will take appropriate action here. this will help community members who are dependent on this usecase.
Thanks,
Prashanth Are
MS Fabric community support
please Mark post as a solution, this will help others! If our response(s) assisted you in any way, don't forget to drop me a "Kudos".
- Gpop13
I can see that the feature is in preview now, however, the CICD and deployment pipeline support is only for any items created after today? What about the dataflow gen2 created before?
- v-prasare
To enable CI/CD and Git integration for your existing Dataflow Gen2 items, you will need to recreate them with the integration enabled. This involves creating a new Dataflow Gen2, enabling Git integration during its creation, and then replicating the configurations and dataflows from your existing dataflow into the new one. Once this process is complete, the new dataflow will support CI/CD and Git integration.
Thanks,
Prashanth Are
MS Fabric community support
- Gpop13
Thanks v-prasare for the response. I have started recreating the dataflow gen2 with enabled Git integration. However, I have hit a major blocker since it seems the data pipelines won't be able to add these new dataflows for orchestration. So it is of no use to me even if I recreate, unless I can use them in a data pipeline activity, which the the main orchestration process I am using. Is there a workaround for this?
- Orchestrating a refresh of a Dataflow Gen2 with CI/CD and Git support isn't possible in Fabric data pipelines.