Forum Discussion
Pipeline's Dataflow task cannot 'see' my Dataflow
Hi,
Just had the exact same issue with one of my colleagues. The dataflow gen2 with CI/CD support does not work in Data pipelines. This is listed in the Limitations and Known Issues of that new Dataflow with CI/CD support.
We just had to remake the dataflow in a normal Dataflow Gen2.
Be advised, you have to create that Dataflow in the main folder of the Workspace otherwise it will start a Dataflow with CI/CD support and will not give you the option to disable the preview checkbox.
It's really disappointing to see that even basic Dataflow-features are not even working in the Preview-version.
I am advising our entire team to stay away from the CI/CD-dataflow untill it is completely operational. This is holding back our entire CI/CD-implementation on Fabric.
So before tinkering with the new Dataflow Preview, i would suggest to read those Restrictions & Known Issues very carefully.
Best of luck, I hope this answers your question!
Hi,
Just had the exact same issue with one of my colleagues. The dataflow gen2 with CI/CD support does not work in Data pipelines. This is listed in the Limitations and Known Issues of that new Dataflow with CI/CD support.
We just had to remake the dataflow in a normal Dataflow Gen2.
Be advised, you have to create that Dataflow in the main folder of the Workspace otherwise it will start a Dataflow with CI/CD support and will not give you the option to disable the preview checkbox.
It's really disappointing to see that even basic Dataflow-features are not even working in the Preview-version.
I am advising our entire team to stay away from the CI/CD-dataflow untill it is completely operational. This is holding back our entire CI/CD-implementation on Fabric.
So before tinkering with the new Dataflow Preview, i would suggest to read those Restrictions & Known Issues very carefully.
Best of luck, I hope this answers your question!
TBNPieter Thanks for your reply.
>>Be advised, you have to create that Dataflow in the main folder of the Workspace otherwise it will start a Dataflow with CI/CD support and will not give you the option to disable the preview checkbox. <<
I was switching to another Workspace and back again to get rid of the "CD/CD (preview)" forced option. But that was, in effect, simply putting me back a the root folder of the Workspace.
Also sucks that for Dataflows, you could never create them from inside a folder. If you did, they ended up in the root folder anyway.
Opinion: I wish Microsoft would take a thrid of the developers they have currently working on AI and CoPilot in Fabric and go back and attend to the technical debt they have amassed over the past 10 years with Power BI and stuff like this. 🙂
