Forum Discussion

divyamalhotra12's avatar
divyamalhotra12
Frequent Visitor
2 years ago
Solved

Data Pipeline - DataFlow Gen 2, Variables assignment

1. I have a dataflow in Data Factory to which I applied some transformations such as 'Unpivot Columns' and 'Group By'. I want to create a pipeline which ensures that new data gets added in my dataflo...
  • Anonymous's avatar
    Anonymous
    2 years ago

    Hi divyamalhotra12 ,

    Inorder to understand what is Data Pipeline -


    List of Data Transformation Options present in Data Pipeline - Data transformation activities - Microsoft Fabric | Microsoft Learn

    Basically if you have Dataflow you can publish it inorder to do transformation. 
    You can schedule the published Dataflow directly without any dependency. 
    If you want to do prior steps before its execution you can use dataflow activity in data pipeline along with some series of activities.

    It completely depends on how do you want to design your pipeline or consume your data flow gen 2. 

    Hope this is helpful. Please let me know if you have any further queries.

  • divyamalhotra12's avatar
    divyamalhotra12
    2 years ago

    "If you want to do prior steps before its execution you can use dataflow activity in data pipeline along with some series of activities."

     

    So, this means, I choose the dataflow activity in my pipeline, select the dataflow and then click on the arrow in the dataflow. That will then take me to the dataflow and I can edit, publish it and come back to my pipeline and run it?