Forum Discussion

TorgeHH's avatar
TorgeHH
Frequent Visitor
1 year ago
Solved

Dataflow Gen2 CI/CD, Preview not working?

Hey there, 

I am currently experimenting a bit with fabric. When I use Dataflows Gen 2 without the preview function, they are working perfectly fine. But as soon as I activate the CI/CD and deployment pipeline feature when I create them, they just wont start running. No matter what I do. There isn't even the option to publish. Just to "save and run". And yeah. They just wont run. 

Is there a certain option that I am missing? I am using a trial capacity currently. But also tried it on an F2.

5 Replies

  • Hello TorgeHH 

     

    • It seems dataflows Gen2 CI/CD and Git inteegration are currently in preview state, there will be a limitations or bugs affecting in their functionality.
    • Make sure that your workspace has Git inteegration enabled. This is a madaatory prerequisite for using CI/CD with dataflows Gen2

     

    Please go through below documentation. it migh helps you

    Dataflow Gen2 with CI/CD and Git integration - Microsoft Fabric | Microsoft Learn

    Known issue - Dataflows Gen2 staging lakehouse doesn't work in deployment pipelines - Microsoft Fabric | Microsoft Learn

     

    Thank you!!!

     

    Did I answer your question? Mark my post as a solution!

    Proud to be a Super User!

  • v-sgandrathi's avatar
    v-sgandrathi
    Community Support

    Hi TorgeHH,

    Thank you for reaching Microsoft Community Forum

     

    Based on your issue with Dataflows Gen2 and CI/CD, suparnababu8 has highlighted the correct points. Please consider the following:

    • CI/CD and Git integration for Dataflows Gen2 is still in preview, so there may be some limitations or bugs affecting its functionality.

    • Make sure that Git integration is enabled in your workspace, as it's required for using CI/CD with Dataflows Gen2. Without it, deployments won’t work.

    • If you're using lakehouses in your deployment pipeline, there's a known issue where they don’t work in staging environments, which could be causing the problem.

    • Since you're using a trial capacity and also tested with an F2 capacity, note that lower-tier capacities may have limitations that prevent full functionality. If possible, try a higher-tier capacity, like P1.

    For more details, you can refer to the official Dataflows Gen2 CI/CD and Git integration documentation on Microsoft Learn as mentioned by the community member.

     

    If this solution worked for you, kindly mark it as Accept as Solution and feel free to give a Kudos, it would be much appreciated!

    Thank you.

    • v-sgandrathi's avatar
      v-sgandrathi
      Community Support

      Hi TorgeHH,

       

      I wanted to check in your situation regarding the issue. Have you resolved it? If you have, please consider marking the reply as Accepted solution and give Kudos that helped you. It would be greatly appreciated by others in the community who may have the same question.

       

      Thankn you for using Microsoft Fabric Community Forum!

       

      • v-sgandrathi's avatar
        v-sgandrathi
        Community Support

        Hi TorgeHH,

         

        May I ask if you have gotten this issue resolved?

        If it is solved, please mark the helpful reply or share your solution and accept it as solution, it will be helpful for other members of the community who have similar problems as yours to solve it faster.

        Thank you.