Forum Discussion

MonztaInc's avatar
MonztaInc
Frequent Visitor
2 years ago
Solved

Update Data Pipeline using Copy Assistant Wizard

Hi there

 

I've created my Data Pipeline using the Copy Assistant Wizard. Once it's created, is there a way to edit the pipeline using the wizard again? 

 

Scenario: 

I built a new pipeline using Copy Assistant Wizard to ingest 10 tables.

Then, ran Pipeline to ingest data. 

Now I want to update pipeline to add more tables using the Copy Assistant Wizard. But I cannot see where/how to do this. 

Is this possible yet? 

 

If not, how does one go about adding more tables to the same copy activity? or do I need new copy activities every time I want to add tables? 

 

Thanks!

 

Need Help
Pipelines
Tips and Tricks
  • Anonymous's avatar
    Anonymous
    2 years ago

    Hi MonztaInc 
    Thanks for the information.
    You can refer to this video for copying bulk tables : Link1
    Hope this helps. Please let me know if you have any further questions.

5 Replies

  • Anonymous's avatar
    Anonymous
    Not applicable
    2 years ago

    Hi MonztaInc 
    Thanks for using Fabric Community. 
    As I understand you are using Copy Assistant Wizard to ingest 10 tables. How are you doing this?
    Can you please attach the screenshots of the pipeline? This would help me in understanding the issue better. 

    However, the Copy Assistant Wizard does not allow you to add more tables to the same copy activity. You can only edit the existing settings of the copy activity, such as the source, destination, mapping, and performance. 
    You should create a new copy activity for each table that you want to add to your pipeline.


  • MonztaInc's avatar
    MonztaInc
    Frequent Visitor
    2 years ago

    hi Anonymous 

    Thanks for the response. 

    As part of the Copy Assistant Wizard, I can select multiple tables. 

     

     

    This then wraps the Copy Activity in a ForEach

     

    Any reason that the Copy Wizard shouldn't be used to update the Copy Activity? (besides the fact the functionality doesn't exist)

    If I've got 100's of tables, I don't want to have a 100's of copy activities. 

    Also don't want to have to re-create the Copy activity each time as this has it's own drawbacks. 

     

     

     

    • Anonymous's avatar
      Anonymous
      Not applicable
      2 years ago

      Hi MonztaInc 
      Thanks for the information.
      You can refer to this video for copying bulk tables : Link1
      Hope this helps. Please let me know if you have any further questions.

      • MonztaInc's avatar
        MonztaInc
        Frequent Visitor
        2 years ago

        Thanks Anonymous 

        Thanks for the link! It's a work around, but will give it a try and see if it fits into the workflow. 

         

        Would much prefer the copy wizard to be able to update the copy activities. 

        Much appreciated.