Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Find everything you need to get certified on Fabric—skills challenges, live sessions, exam prep, role guidance, and more. Get started

Reply
ctaulbee
New Member

Optimal VM setup for Enterprise Gateway?

Hi All,

 

I'm looking to set up some virtual machines to host data gateways for refreshing my data. Is there an optimal set up that keeps costs down with consistent performance? I plan on refreshing maybe 5 times a day? Up to 8.

 

Any resources would be appreciated.

 

Chris

2 REPLIES 2
lbendlin
Super User
Super User

5 to 8 refreshes a day?  You barely need a single VM for that.

 

Here's what we use in our company (in addition to all the rogue single-VM gateways):

 

- gateway cluster with four VM members, geographically dispersed for BCP reasons

- each VM has 8 cores, 32GB RAM, 100GB free disk space

- all VMs are running Server 2012 R2 (meh) with all the latest and greatest patches applied and all required database drivers installed (Oracle, MySQL, PostGres, Vertica, HortonWorks etc etc.)

- extensive monitoring to make sure all cluster members get their fair share of work and that refresh queries complete in reasonable amount of time

 

This setup supports about 150 connections and about 500 refreshes per day with some breathing space.  The Gateway Admin console is a surprising bottleneck as it gets really slow after you add 100 or so connections.

Greg_Deckler
Super User
Super User

@ctaulbee - 

It can be difficult to accurately estimate the right size. We recommend that you start with a machine with at least 8 CPU cores, 8 GB of RAM, and multiple Gigabit network adapters. You can then measure a typical gateway workload by logging CPU and memory system counters. For more information, see Monitor and optimize on-premises data gateway performance.

From - https://docs.microsoft.com/en-us/power-bi/guidance/gateway-onprem-sizing

 

You could try starting with a D2 v3 which is about $150/month. Might be OK. Worst case, go with a D8 v3 for $600/month. If you only run it during business hours (8 hours a day) those costs are 1/3rd or less (no weekends)

 


Follow on LinkedIn
@ me in replies or I'll lose your thread!!!
Instead of a Kudo, please vote for this idea
Become an expert!: Enterprise DNA
External Tools: MSHGQM
YouTube Channel!: Microsoft Hates Greg
Latest book!:
The Definitive Guide to Power Query (M)

DAX is easy, CALCULATE makes DAX hard...

Helpful resources

Announcements
Europe Fabric Conference

Europe’s largest Microsoft Fabric Community Conference

Join the community in Stockholm for expert Microsoft Fabric learning including a very exciting keynote from Arun Ulag, Corporate Vice President, Azure Data.

Power BI Carousel June 2024

Power BI Monthly Update - June 2024

Check out the June 2024 Power BI update to learn about new features.

RTI Forums Carousel3

New forum boards available in Real-Time Intelligence.

Ask questions in Eventhouse and KQL, Eventstream, and Reflex.