Forum Discussion

arkiboys2's avatar
arkiboys2
Icon for Helper IV rankHelper IV
2 years ago
Solved

check accuracy of data load

how is it possible to check/compare the source to the destination? for example, the data factory pipelines load data from sql server into warehouse tables and now I would like to see if the loaded d...
  • Anonymous's avatar
    Anonymous
    2 years ago

    Hi arkiboys2 ,

    I think you can join TABLE1 and TABLE2 first, then use filter to get the rows which's type isn't same. Next create a DerivedColumn to generate Type Change column. Finally, use Select transformation to remain the columns you need.

     

    1. Create Join transformation to TABLE1 and TABLE2.

    2. Filter the rows which's type isn't same. Expression: source2@Type != source1@Type

    3. Add Type Change column. Expression:concat('from ',source1@Type,' to ', source2@Type)

    4. Use Select transformation to remain the columns you need.

    Then you will see what you want.

     

     

     

    Best Regards

    Yilong Zhou

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.