Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Find everything you need to get certified on Fabric—skills challenges, live sessions, exam prep, role guidance, and more. Get started

Reply
ScottPowellECU
Advocate II
Advocate II

Microsoft - new gateway server network diagram?

Hi folks, Microsoft had published a network diagram for how the gateway servers worked in Power BI ( https://learn.microsoft.com/en-us/data-integration/gateway/service-gateway-onprem-indepth )

 

From my understanding this doesn't apply to Fabric - it seems that the gateway server needs to be able to talk directly to the Power BI aka Fabric service on port 1433 to load data to a warehouse or lakehouse. I'm understanding this due to the fact that loads are failing if port 1433 is blocked from the gateway server.

 

Just wanted Microsoft to be aware that this diagram needs updated. Are there other changes than a new direct connection between the gateway servers and the SQL endpoints?

 

Thanks,

Scott

9 REPLIES 9
nikkiwaghani
Microsoft Employee
Microsoft Employee

This should be addressed with the July release of the gateway. Can you update and try again?

Also, I can confirm that this does apply to Fabric - we will update the image, good catch on that.

AnthonyGenovese
Resolver III
Resolver III

It looks like the new July 2023 Gateway server addresses a lot of these issues.

Oh man, I hope you're right. I've had really spotty "success" trying to get onprem data into Fabric so far and am feeling like maybe it's time to set this aside until it matures a bit more.

I was in the exact same boat. Bashing my head with issue after issue. 3 new errors in the past 24 hours. But then I just refreshed a dataflow today to get a baseline, and it worked. Only thing that changed from previous attempts was an updated gateway.  Fingers crossed for you. 

It's better. I'd been able to get around 25k rows to load consistently(ish). That number is more like 50k rows now. The table I want to load has 5 million rows. At this point I'm not even loading from on-prem but am hitting an Azure SQL database. Maybe Gen2 dataflows just aren't ready for primetime yet. 

 

The new results are after updating to the July 2023 gateway.

marcoG
Resolver I
Resolver I

Hi @ScottPowellECU ,

I found this article:

https://learn.microsoft.com/en-us/fabric/data-factory/gateway-considerations-output-destinations

 

marcoG_0-1689752706476.png

 

 

 

And this fabric blog article:

https://blog.fabric.microsoft.com/it-it/blog/data-factory-spotlight-dataflows-gen2?ft=All:

 

marcoG_1-1689752706482.png

 

 

So i will attend for next release to disable staging area so I don’t need to use 1433 port.

I think this will work for me.

Bye

 

MG

 

motoray
Helper V
Helper V

This is new and I don't really understand why. I've been able to get data loaded into staging warehouses and lakehouses so it doesn't make much sense to me that the step of loading data to the actual warehouse needs to suddenly connect to the gateway servers on that port.

I totally agree. 

Agree 100%!

Scott

Helpful resources

Announcements
Sept Fabric Carousel

Fabric Monthly Update - September 2024

Check out the September 2024 Fabric update to learn about new features.

Expanding the Data Factory Forums

New forum boards available in Data Factory

Ask questions in Apache Airflow Job and Mirroring.

September Hackathon Carousel

Microsoft Fabric & AI Learning Hackathon

Learn from experts, get hands-on experience, and win awesome prizes.

Sept NL Carousel

Fabric Community Update - September 2024

Find out what's new and trending in the Fabric Community.

Top Solution Authors