Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
1 year ago
Solved

Collaboration in Dataflows?

Does anyone here have advice (from documentation or from experience) for working with dataflows as part of a dev team?

 

Ideally, we'd like for more than one person to familiarize themselves with how a dataflow is working. To my understanding, each person would have to take-over the dataflow before being able to see the logic. We'd also like to track changes somehow, but didn't see a straightforward way to do so for dataflows.

 

For this reason, we've tried favoring notebooks, but the dataflows work really well for coworkers who aren't developers (e.g. tech-minded analysts). We are trying to figure out what options we have to make working with them a bit smoother. Any tips/tricks or features/plans I may not know about would help! Of course, if I'm misunderstanding the intended use/workflow for dataflows, knowing that would help too!

Data Engineering

7 Replies

  • lbendlin's avatar
    lbendlin
    Super User
    1 year ago

    You are spot on.  The need to "take over"  is one of the biggest issues with dataflows.

  • Anonymous's avatar
    Anonymous
    Not applicable
    1 year ago

    Hi Anonymous ,

     

    Thanks for the reply from lbendlin .

     

    To collaborate in dataflow, you can share your workspace with your team members by adding them as roles in your workspace.

     

    This way your team members can all access and collaborate on the data flow, and can all see and work on the same data flow without having to take over.

     

    Best Regards,
    Yang
    Community Support Team

     

    If there is any post helps, then please consider Accept it as the solution  to help the other members find it more quickly.
    If I misunderstand your needs or you still have problems on it, please feel free to let us know. Thanks a lot!

    • Anonymous's avatar
      Anonymous
      Not applicable
      1 year ago

      For the benefit of anyone referencing this post at a future time - this does not appear to be how it works as of today. Clicking to see a DataflowGen2 prompts you to take-over the flow in order to interact with it. If there is another way to view it, I have not found it in the UI or the documentation.

       

      The prompt:

       

      • lbendlin's avatar
        lbendlin
        Super User
        1 year ago

        One thing you can do to mitigate that issue is to regularly export the .JSON and push that into your github repo.