Fabric Data Pipeline - Can I use a Dataflow Gen 2 for an activity?

[Anonymous]

When I drag and drop a Dataflow Activity into my canvas within the Data Pipeline experience, I only see Dataflows Gen 1 within the workspace I choose to select from. Is this a current limitation, not being able to use Dataflows Gen 2 inside of Pipelines?

[Anonymous · Accepted solution]

I figured it out! With the current maturity of the preview feature pictured below, it will not allow you to publish a dataflow if enabled. When I left it unselected and created my Dataflow Gen 2, then it allowed me to 'Publish' my dataflow Gen 2, and be able to see in a Fabric Pipeline

[v-nmadadi-msft]

Hi  @Anonymous,
Thanks for reaching out to the Microsoft fabric community forum.

As of now there are no known issues in dataflow gen2 not working in pipelines,
as mentioned by @uzuntasgokberk  please check if the dataflow has been published.
Challenges have been noted when deploying Dataflow Gen2 through deployment pipelines, particularly concerning dataflow dependencies and environment configurations. Ensuring consistent IDs and configurations across environments is crucial. ​
Please check this thread where a similar issue has been discussed: Solved: Dataflow Gen 2 Deployment Pipeline Issue - Microsoft Fabric Community

If you find this post helpful, please mark it as an "Accept as Solution" and consider giving a KUDOS.
Thanks and Regards

[uzuntasgokberk]

Hello @Anonymous ,

You can use dataflow gen2 too. Just don't forget to click publish button.

Kind Regards,
Gökberk Uzuntaş

📌 If this post helps, then please consider Accepting it as a solution and giving Kudos — it helps other members find answers faster!

🔗 Stay Connected:
📘 Medium |
📺 YouTube |
💼 LinkedIn |
📷 Instagram |
🐦 X |
👽 Reddit |
🌐 Website |
🎵 TikTok |

[Anonymous]

@uzuntasgokberk Thanks for the instructions and screen shot. I am not getting the same visual interface experience you are. I do not have a publish button for some reason. 

No 'Publish' button in bottom right

I have a 'Save & run' button that you would think accomplish the same thing

I can confirm the On Demand Run Success

There is still no Dataflow Gen 2 available for me to add as an activity to the pipeline in the same workspace. Peculiar