Forum Discussion

imranshabbir's avatar
imranshabbir
Frequent Visitor
2 years ago

Performance issue of Copy Activity in fabric

I'm facing performance issues in copy activity as I'm trying to fetch data from synapse to lakhouse but the thorughput I'm getting is in kbs. I have implemented the dynamic range but still facing the same issue.

data engineering
data pipeline
lakehouse

4 Replies

  • Anonymous's avatar
    Anonymous
    Not applicable
    2 years ago

    Hi imranshabbir,

    Can you please share some more detail information about this operation and configuration? They should help us clarify your scenario and test to troubleshoot.

    For example: 

    What type of data source are you used to copy data? Is this data source stored on cloud or on-premise? Does these operations required a gateway, and where the device that installed the gateway hosts?

    Regards,

    Xiaoxin Sheng

    • imranshabbir's avatar
      imranshabbir
      Frequent Visitor
      2 years ago

      We are using synapse as source and fabric lakehouse as target. And yes these operations require a gateway.

      • Anonymous's avatar
        Anonymous
        Not applicable
        2 years ago

        HI imranshabbir,

        So you means these data are stored on azure synapse side and mapping with on-premise data source based on data gateway?
        How did the network connection status between azure and gateway? Did these source and gateway managed on the same data regions?
        They may cause the addition cost and affect performance when executed the connect and getting data steps.
        Regards,

        Xiaoxin Sheng

  • Anonymous's avatar
    Anonymous
    Not applicable
    2 years ago

    HI imranshabbir,

    Any update on this? Did this issue still appears on your side?
    Regards,

    Xiaoxin Sheng