Dataflow Gen2 CI/CD, Preview not working?

[TorgeHH]

Hey there, 

I am currently experimenting a bit with fabric. When I use Dataflows Gen 2 without the preview function, they are working perfectly fine. But as soon as I activate the CI/CD and deployment pipeline feature when I create them, they just wont start running. No matter what I do. There isn't even the option to publish. Just to "save and run". And yeah. They just wont run. 

Is there a certain option that I am missing? I am using a trial capacity currently. But also tried it on an F2.

[v-sgandrathi]

Hi @TorgeHH,

Thank you for reaching Microsoft Community Forum

Based on your issue with Dataflows Gen2 and CI/CD, @suparnababu8 has highlighted the correct points. Please consider the following:

• CI/CD and Git integration for Dataflows Gen2 is still in preview, so there may be some limitations or bugs affecting its functionality.

• Make sure that Git integration is enabled in your workspace, as it's required for using CI/CD with Dataflows Gen2. Without it, deployments won’t work.

• If you're using lakehouses in your deployment pipeline, there's a known issue where they don’t work in staging environments, which could be causing the problem.

• Since you're using a trial capacity and also tested with an F2 capacity, note that lower-tier capacities may have limitations that prevent full functionality. If possible, try a higher-tier capacity, like P1.

For more details, you can refer to the official Dataflows Gen2 CI/CD and Git integration documentation on Microsoft Learn as mentioned by the community member.

If this solution worked for you, kindly mark it as Accept as Solution and feel free to give a Kudos, it would be much appreciated!

Thank you.

[v-sgandrathi]

Hi @TorgeHH,

I wanted to check in your situation regarding the issue. Have you resolved it? If you have, please consider marking the reply as Accepted solution and give Kudos that helped you. It would be greatly appreciated by others in the community who may have the same question.

Thankn you for using Microsoft Fabric Community Forum!

[v-sgandrathi]

Hi @TorgeHH,

May I ask if you have gotten this issue resolved?

If it is solved, please mark the helpful reply or share your solution and accept it as solution, it will be helpful for other members of the community who have similar problems as yours to solve it faster.

Thank you.

[v-sgandrathi]

Hi @TorgeHH,

As we have not received a response from you yet, I would like to confirm whether you have successfully resolved the issue or if you require further assistance.

If the issue has been resolved, please mark the helpful reply as a "solution" to indicate that the question has been answered and to assist others in the community.

Thank you.

[suparnababu8 · Accepted solution]

Hello @TorgeHH 

• It seems dataflows Gen2 CI/CD and Git inteegration are currently in preview state, there will be a limitations or bugs affecting in their functionality.
• Make sure that your workspace has Git inteegration enabled. This is a madaatory prerequisite for using CI/CD with dataflows Gen2

Please go through below documentation. it migh helps you

Dataflow Gen2 with CI/CD and Git integration - Microsoft Fabric | Microsoft Learn

Known issue - Dataflows Gen2 staging lakehouse doesn't work in deployment pipelines - Microsoft Fabr...

Thank you!!!

Did I answer your question? Mark my post as a solution!

Proud to be a Super User!