Forum Discussion

dbeavon3's avatar
dbeavon3
Memorable Member
2 years ago

Is there a plan for retrieving code from dataflows for the sake of source control?

I noticed that Microsoft finally came up with a "developer mode" for turning local PBIX assets into something that can be included in a source control system like git.

 

Is there any similar concept of a "developer mode" on the service side?  I need to be able to download all the code from a workspace in a format that can be included into a source control system.

 

Today I'm working with manual operations to retrieve dataflow-PQ (and dataflow-gen2-PQ) in the form of json files, or pqt files or whatever.  It is a nightmare.  I'm guessing this is not something that is on Microsoft's radar.  It took them a decade to come up with "developer mode", and I'm guessing that retrieving our source code from the service will take even longer than that.

 

If anyone is aware of a general-purpose way of making our dataflow code more accessible to us, please let me know.

 

 

5 Replies

    • dbeavon3's avatar
      dbeavon3
      Memorable Member

      I'm not seeing data flows gen 2 in the list of supported items

      • GilbertQ's avatar
        GilbertQ
        Super User

        Hi dbeavon3 

         

        Apologies for that you are right in the dataflow gen2 is not supported for Version control.

  • dbeavon3's avatar
    dbeavon3
    Memorable Member

    Hi GilbertQ 
    Thanks for the tip.

    I'm not seeing data flows gen 2 in the list of supported items:
    https://learn.microsoft.com/en-us/fabric/cicd/git-integration/intro-to-git-integration#supported-items


    Have you tested with DF gen 2 yet?  Does it save the entire PQ script as a one-liner as json, or as a binary PQT file?

    I'm really curious about the path forward with this stuff, and I'm hoping Microsoft prioritizes it and delivers something in under a year.  The "developer mode" for PBI desktop seems to be dragging on forever.  Why does Microsoft always start thinking about source control (& CI/CD) as an afterthought?  What kind of software developers find this acceptable?  I feel always feel like I'm living in some parallel universe whenever I'm working with these Power BI tools.

    I really hope that the git integration is nothing like it was in ADF/Synapse.  Those integrations were better than nothing at all, but were very cumbersome compared to the patterns used in modern software development.