Skip to main content
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Did you hear? There's a new SQL AI Developer certification (DP-800). Start preparing now and be one of the first to get certified. Register now

lrtoyou1223
Microsoft Employee
‎03-26-2024 01:00 PM

Integrating On-Premises Data into Microsoft Fabric Using Data Pipelines in Data Factory

We are thrilled to announce the public preview of on-premises connectivity for Data pipelines in Microsoft Fabric.

Using the on-premises Data Gateway, customers can connect to on-premises data sources using dataflows and data pipelines with Data Factory in Microsoft Fabric. This enhancement significantly broadens the scope of data integration capabilities. In essence, by using an on-premises Data Gateway, organizations can keep databases and other data sources on their on-premises networks while securely integrating them to Microsoft Fabric (cloud).

Thank you to all product feedback from customers and the Microsoft Fabric community who have been working with us closely to deliver this new capability!

Integrating_On-Premises_Data_into_Microsoft_Fabric_Using_Data_Pipelines_in_DataIntegrating_On-Premises_Data_into_Microsoft_Fabric_Using_Data_Pipelines_in_Data

Let's help you get started!

Create an on-premises data gateway

  1. An on-premises data gateway is a software designed to be installed within a local network environment. It provides a means to directly install the gateway onto your local machine. For detailed instructions on how to download and install the on-premises data gateway, refer to Install an on-premises data gateway.
  2. Sign-in using your user account to access the on-premises data gateway, after which it's prepared for utilization.

Create a connection for your on-premises data source

  1. Navigate to the admin portal and select the settings button (an icon that looks like a gear) at the top right of the page. Then choose Manage connections and gateways from the dropdown menu that appears.

Integrating_On-Premises_Data_into_Microsoft_Fabric_Using_Data_Pipelines_in_DataIntegrating_On-Premises_Data_into_Microsoft_Fabric_Using_Data_Pipelines_in_Data

2. On the New connection dialog that appears, select On-premises and then provide your gateway cluster, along with the associated resource type and relevant information.

Integrating_On-Premises_Data_into_Microsoft_Fabric_Using_Data_Pipelines_in_DataIntegrating_On-Premises_Data_into_Microsoft_Fabric_Using_Data_Pipelines_in_Data

Using on-premises data in a pipeline

  1. Go to your workspace and create a Data Pipeline.

Integrating_On-Premises_Data_into_Microsoft_Fabric_Using_Data_Pipelines_in_DataIntegrating_On-Premises_Data_into_Microsoft_Fabric_Using_Data_Pipelines_in_Data

2. Add a new source to the pipeline copy activity and select the connection established in the previous step.

Integrating_On-Premises_Data_into_Microsoft_Fabric_Using_Data_Pipelines_in_DataIntegrating_On-Premises_Data_into_Microsoft_Fabric_Using_Data_Pipelines_in_Data

Integrating_On-Premises_Data_into_Microsoft_Fabric_Using_Data_Pipelines_in_DataIntegrating_On-Premises_Data_into_Microsoft_Fabric_Using_Data_Pipelines_in_Data

3. Select a destination for your data from the on-premises source.

Integrating_On-Premises_Data_into_Microsoft_Fabric_Using_Data_Pipelines_in_DataIntegrating_On-Premises_Data_into_Microsoft_Fabric_Using_Data_Pipelines_in_Data

4. Run the pipeline.

Integrating_On-Premises_Data_into_Microsoft_Fabric_Using_Data_Pipelines_in_DataIntegrating_On-Premises_Data_into_Microsoft_Fabric_Using_Data_Pipelines_in_Data

You have now created a pipeline to load data from an on-premises data source into a cloud destination.

Resources to help you get started

Have any questions or feedback? Leave a comment below!

Labels:
0