Forum Discussion

ScottPowellECU's avatar
ScottPowellECU
Icon for Advocate II rankAdvocate II
3 years ago

Copy data for on-prem SQL server

Hi, does anyone have an idea of when the "Copy data" activity might work for on-prem data sources (in our case SQL Server)? I know we can use Gen2 dataflows for this - but they are very slow. Really ...
Need Help
pipelines
bcdobbs's avatar
bcdobbs
Icon for Community Champion rankCommunity Champion
3 years ago

What sort of transfer rates ar you getting in gen2 dataflows? Mine just took an hour to load a 2gb table from On Prem SQL. Trying to work out if it's our environment or just how it is.

Scott_Powell's avatar
Scott_Powell
Icon for Helper V rankHelper V
3 years ago

FYI bcdobbs  - the 2GB / hr seems roughly in line with what we get with stuff going through the gateway server. That's with a 3 gateway cluster but I haven't spent any time getting fancy with things like trying to partition the data (via incremental refresh) to get multiple loads running in parallel.

 

Hope this helps,

Scott