Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Earn the coveted Fabric Analytics Engineer certification. 100% off your exam for a limited time only!

Reply
alfBI
Helper III
Helper III

Data Factory - SQL Server Source (Gateway)

Hi, 

 

I am trying to develop a Fabric Data Factory Pipeline getting data from a source placed on a on-premise SQL Server.

 But when I establish the connection I don't see the way to define the gateway (as it should, otherwise I have no idea how it is expected he found it 🙂 )

 

alfBI_0-1685297045034.png

 

Any idea about what am I missing here to use a on-premise database source on a Fabric Data Factory Pipeline?

 

Regards

 

 

1 ACCEPTED SOLUTION
GraceGu
Employee
Employee

Pipeline copy on-prem access (by SHIR in ADF) is not available yet. You can refer to Differences between Data Factory in Fabric and Azure - Microsoft Fabric | Microsoft Learn to get an idea on what are there and what are not.  Right now, you can use dataflow to access on-prem resources.  

View solution in original post

7 REPLIES 7
germo
Advocate IV
Advocate IV

I created a "Dataflow Gen2", which works like Power Query. I used the "On-premises data gateway" as source, Lakehouse as destination, and this works fine.

germo
Advocate IV
Advocate IV

is there a roadmap when the "On-premises Data Gateway(in design)" could be available?
Are there any workarounds to copy data from on premise to fabric?
Power BI has a gateway, it works fine. But it can't be used with fabric.

Or maybe there is am easy way to first export from on premise SQL Server into Parquet file and then to upload it?

GraceGu
Employee
Employee

Pipeline copy on-prem access (by SHIR in ADF) is not available yet. You can refer to Differences between Data Factory in Fabric and Azure - Microsoft Fabric | Microsoft Learn to get an idea on what are there and what are not.  Right now, you can use dataflow to access on-prem resources.  

Hi,

 

Thx for the link. I missed it. Effectively there is some significant difference with ADF with regard integrated runtimes

alfBI_0-1685341010560.png

 

good news are that on-premise data gateway support feature seems to be on the roadmap and currently in progress. So we will have to wait a bit or use Dataflows as workaround.....

 

Thx

 

 

vgvozdev
New Member

Hi,

 

I have the same issue. What is the proper way to connect to the On-Prem SQL Server? 

I think they either making a mistake about the SQL SERVER connector (it seems the connector setting is to azure instead of on-premise) or they assume us to use Dataflow? to pulling data from on-premise server. 

 

Btw, dataflow gen 2 does work due to gateway problem. 

 

Re: Problem running a gen2 dataflow from a non azu... - Microsoft Fabric Community

I have no experience with ADF as we don't really use Azure. I'm super curious - for folks that have used both ADF and Dataflows via an on-prem gateway, is ADF significantly faster?

 

It takes a pretty long time to copy data across via our gateway servers. I'm hoping ADF is at least an order of magnitude faster.

 

Thanks,

Scott

Helpful resources

Announcements
April AMA free

Microsoft Fabric AMA Livestream

Join us Tuesday, April 09, 9:00 – 10:00 AM PST for a live, expert-led Q&A session on all things Microsoft Fabric!

March Fabric Community Update

Fabric Community Update - March 2024

Find out what's new and trending in the Fabric Community.

Top Kudoed Authors