Fabric Data Pipeline - Can I use a Dataflow Gen 2 for an activity?

[Anonymous]

When I drag and drop a Dataflow Activity into my canvas within the Data Pipeline experience, I only see Dataflows Gen 1 within the workspace I choose to select from. Is this a current limitation, not being able to use Dataflows Gen 2 inside of Pipelines?

[Anonymous · Accepted solution]

I figured it out! With the current maturity of the preview feature pictured below, it will not allow you to publish a dataflow if enabled. When I left it unselected and created my Dataflow Gen 2, then it allowed me to 'Publish' my dataflow Gen 2, and be able to see in a Fabric Pipeline

[v-nmadadi-msft]

Hi  @Anonymous,
Thanks for reaching out to the Microsoft fabric community forum.

As of now there are no known issues in dataflow gen2 not working in pipelines,
as mentioned by @uzuntasgokberk  please check if the dataflow has been published.
Challenges have been noted when deploying Dataflow Gen2 through deployment pipelines, particularly concerning dataflow dependencies and environment configurations. Ensuring consistent IDs and configurations across environments is crucial. ​
Please check this thread where a similar issue has been discussed: Solved: Dataflow Gen 2 Deployment Pipeline Issue - Microsoft Fabric Community

If you find this post helpful, please mark it as an "Accept as Solution" and consider giving a KUDOS.
Thanks and Regards

[uzuntasgokberk]

Hello @Anonymous ,

You can use dataflow gen2 too. Just don't forget to click publish button.

Best Regards,
Gökberk Uzuntaş

LinkedIn: https://www.linkedin.com/in/g%C3%B6kberk-uzunta%C5%9F-b43906198/

Medium: https://medium.com/@uzuntasgokberk

İf this post helps, then please consider Accept it as solution and kudos to help the other members find it more quickly.

[Anonymous]

@uzuntasgokberk Thanks for the instructions and screen shot. I am not getting the same visual interface experience you are. I do not have a publish button for some reason. 

No 'Publish' button in bottom right

I have a 'Save & run' button that you would think accomplish the same thing

I can confirm the On Demand Run Success

There is still no Dataflow Gen 2 available for me to add as an activity to the pipeline in the same workspace. Peculiar