Forum Discussion

TWorku's avatar
TWorku
Frequent Visitor
2 years ago
Solved

Data Pipleline : Copy Data : Can we do precedence constraint just like SSIS?

Hello Community    I have a Data Pipeline that includes a task for copying CSV files. My goal is for the pipeline to proceed to the next step only if the copy task successfully copies a file. I ini...
  • Anonymous's avatar
    Anonymous
    2 years ago

    Hi TWorku 

     

    To ensure that the file is found and the data is successfully copied before the next action is performed, you can add additional check steps to the pipeline to verify that the replication activity successfully copied the data.

     

    Add another Lookup Activity after the Copy activity to verify if the copied data exists in the destination location.


    Configure the Lookup Activity to check if the copied data exists in the destination location.


    Add an If Condition Activity after the Lookup Activity.


    Configure the If Condition Activity to evaluate the result of the Lookup Activity. The condition should check if the copied data exists in the destination location.


    True Path:
    Add the subsequent pipeline activities. This path will be executed if the Lookup Activity confirms that the data has been successfully copied.


    False Path:
    Add a Fail Activity to handle the scenario where the data was not successfully copied. This ensures that the pipeline does not proceed if the data was not successfully copied.

     

     

     

    Regards,

    Nono Chen

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.