Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Get Fabric Certified for FREE during AI Skills Fest. This week only. Secure your voucher now.

yexu

Fast Copy with On-premises Data Gateway Support in Dataflow Gen2

Fast Copy boosts the speed and cost-effectiveness of your Dataflows Gen2. We loaded a 6 GB CSV file to a Lakehouse table in Microsoft Fabric with 8x faster and 3x cheaper result. See our last post for details.

Today, we're excited to announce that Fast Copy in Dataflow Gen2 now supports high-performance data transfers from on-premises data stores using a gateway. You can use your existing on-premises data gateway in your Data Factory to access on-premise stores like SQL Server with Fast Copy in Dataflow Gen2.

Let's see how it works. 

Assume that you have the on-premises data gateway installed and registered in your Data Factory as below.

Fast_Copy_with_On-premises_Data_Gateway_Support_in_Dataflow_Gen2Fast_Copy_with_On-premises_Data_Gateway_Support_in_Dataflow_Gen2

Create your Dataflow Gen2, and you can access data from a SQL Server through that on-premises data gateway.

Fast_Copy_with_On-premises_Data_Gateway_Support_in_Dataflow_Gen2Fast_Copy_with_On-premises_Data_Gateway_Support_in_Dataflow_Gen2

Click the Options button from Dataflow Gen2 pane to enable Fast Copy feature.

Fast_Copy_with_On-premises_Data_Gateway_Support_in_Dataflow_Gen2Fast_Copy_with_On-premises_Data_Gateway_Support_in_Dataflow_Gen2

Fast_Copy_with_On-premises_Data_Gateway_Support_in_Dataflow_Gen2Fast_Copy_with_On-premises_Data_Gateway_Support_in_Dataflow_Gen2

The indicator will also show you that your data will be loaded via Fast Copy after evaluating your data loading step.

Fast_Copy_with_On-premises_Data_Gateway_Support_in_Dataflow_Gen2Fast_Copy_with_On-premises_Data_Gateway_Support_in_Dataflow_Gen2

After you finish all the configurations in Dataflow Gen2, publish it. You will see the copy activity engine is used to transfer your data from an on-premises SQL Server in a fast way.

Fast_Copy_with_On-premises_Data_Gateway_Support_in_Dataflow_Gen2Fast_Copy_with_On-premises_Data_Gateway_Support_in_Dataflow_Gen2

More resources

Have any questions or feedback? Leave a comment below!