Forum Discussion
Dataflow gen2 - multiple staging artifacts
- 1 year ago
You're welcome. While I don't find any documentation that specifically confirms the reasoning, I believe the purpose for having multiple staging warehouses is because it will provide better capabilities for things like rollback and auditing, and possibly parallel processing as well. Since dataflow gen2 CICD is still in preview some things are likely to change, this is probably one of them. Please let me know if I can answer any other questions. Thanks!
Hey NiklasBDP,
I am seeing the exact same thing and it is quite annoying. We are implementing a Fabric architecture that relies very heavy on dataflows. We are currently testing for using CI/CD so are making DF2 with CI/CD and this just feels very messy to have multiple StagingWarehouseForDataflows. This has to be fixed somehow? Any news or did you find a solution to your problem?
Kind regard,s
- NiklasBDP1 year agoFrequent Visitor
No I did not find a solution except that jennratten, wrote that this is in preview and hopefully will be fixed before final release. So I do not enable CI/CD for dataflows at the moment.