Forum Discussion

ScottPowellECU's avatar
ScottPowellECU
Advocate II
3 years ago

Copy data for on-prem SQL server

Hi, does anyone have an idea of when the "Copy data" activity might work for on-prem data sources (in our case SQL Server)? I know we can use Gen2 dataflows for this - but they are very slow. Really ...
Need Help
Pipelines
AlexPowers's avatar
AlexPowers
Microsoft Employee
3 years ago

Hey Scott! Saw your comment in another thread with respect to being able to support on-prem connectivity via pipelines, this is a top priority to bring to Fabric as part of the team's path to General Availability. There will be some improvements brought to Dataflows to help with ingestion (leveraging the same underlying copy activity / fast copy infrastructure of pipelines) there are still few items to resolve to get us there but if you can help the team out by voting over on Fabric ideas so they can best prioritize the necessary  work: https://aka.ms/fabricideas 

  • Scott_Powell's avatar
    Scott_Powell
    Advocate IV
    3 years ago

    Hi AlexPowers , appreciate the reply - thank you very much! I'll definitely vote in the fabric ideas area, but I'll also throw out there: wihtout this capability, it's really limiting your customers to ones that are already buying Azure from you, and doesn't help attract new customers who (like us) can't move our on-prem SQL server to the cloud easily.

     

    I appreciate the response - thank you!

    Scott

  • Trystan's avatar
    Trystan
    Frequent Visitor
    2 years ago

    Hey AlexPowers, any updates on when this might become available?

     

    Thanks

  • MisterSmith's avatar
    MisterSmith
    Helper I
    3 years ago

    Hi Alex

    Do you know if the copy data activity in pipelines to on prem systems is available yet?  And if not are there any timescales as to when it will be?

     

    Thanks

     

    Neil

  • ScottPowellECU's avatar
    ScottPowellECU
    Advocate II
    2 years ago

    hi AlexPowers , just wanted to follow up and see if there's been any progress on using pipelines and the copy activity to bring on-prem SQL server data into Fabric. Been a couple of months, hoping we're getting close. Gen2 dataflow performance is just too slow for the amounts of data we're hoping to move to Fabric.

     

    Thanks!

    Scott

  • Dhicks's avatar
    Dhicks
    Frequent Visitor
    2 years ago

    Hi @AlexPowers

     

    Fabric has now gone General Availability, do you have any idea of the timeframe to support Copy Data activity for pipelines, through a On Premise Data gateway?


    Thanks

     

  • JFTxJ's avatar
    JFTxJ
    Advocate III
    2 years ago

    Hi AlexPowers ,

    Thank you for this statement as it makes me feel much better. "this is a top priority to bring to Fabric as part of the team's path to General Availability."

     

    As-of today, is-there any news on when on-prem connectivity via pipelines would become available?