Forum Discussion

imranshabbir's avatar
imranshabbir
Frequent Visitor
2 years ago

Performance issue of Copy Activity in fabric

I'm facing performance issues in copy activity as I'm trying to fetch data from synapse to lakhouse but the thorughput I'm getting is in kbs. I have implemented the dynamic range but still facing the...
data engineering
data pipeline
lakehouse
Anonymous's avatar
Anonymous
Not applicable
2 years ago

Hi imranshabbir,

Can you please share some more detail information about this operation and configuration? They should help us clarify your scenario and test to troubleshoot.

For example: 

What type of data source are you used to copy data? Is this data source stored on cloud or on-premise? Does these operations required a gateway, and where the device that installed the gateway hosts?

Regards,

Xiaoxin Sheng

imranshabbir's avatar
imranshabbir
Frequent Visitor
2 years ago

We are using synapse as source and fabric lakehouse as target. And yes these operations require a gateway.

  • Anonymous's avatar
    Anonymous
    Not applicable
    2 years ago

    HI imranshabbir,

    So you means these data are stored on azure synapse side and mapping with on-premise data source based on data gateway?
    How did the network connection status between azure and gateway? Did these source and gateway managed on the same data regions?
    They may cause the addition cost and affect performance when executed the connect and getting data steps.
    Regards,

    Xiaoxin Sheng