Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

The ultimate Microsoft Fabric, Power BI, Azure AI & SQL learning event! Join us in Las Vegas from March 26-28, 2024. Use code MSCUST for a $100 discount. Register Now

Reply
ctaulbee
New Member

Optimal VM setup for Enterprise Gateway?

Hi All,

 

I'm looking to set up some virtual machines to host data gateways for refreshing my data. Is there an optimal set up that keeps costs down with consistent performance? I plan on refreshing maybe 5 times a day? Up to 8.

 

Any resources would be appreciated.

 

Chris

2 REPLIES 2
lbendlin
Super User
Super User

5 to 8 refreshes a day?  You barely need a single VM for that.

 

Here's what we use in our company (in addition to all the rogue single-VM gateways):

 

- gateway cluster with four VM members, geographically dispersed for BCP reasons

- each VM has 8 cores, 32GB RAM, 100GB free disk space

- all VMs are running Server 2012 R2 (meh) with all the latest and greatest patches applied and all required database drivers installed (Oracle, MySQL, PostGres, Vertica, HortonWorks etc etc.)

- extensive monitoring to make sure all cluster members get their fair share of work and that refresh queries complete in reasonable amount of time

 

This setup supports about 150 connections and about 500 refreshes per day with some breathing space.  The Gateway Admin console is a surprising bottleneck as it gets really slow after you add 100 or so connections.

Greg_Deckler
Super User
Super User

@ctaulbee - 

It can be difficult to accurately estimate the right size. We recommend that you start with a machine with at least 8 CPU cores, 8 GB of RAM, and multiple Gigabit network adapters. You can then measure a typical gateway workload by logging CPU and memory system counters. For more information, see Monitor and optimize on-premises data gateway performance.

From - https://docs.microsoft.com/en-us/power-bi/guidance/gateway-onprem-sizing

 

You could try starting with a D2 v3 which is about $150/month. Might be OK. Worst case, go with a D8 v3 for $600/month. If you only run it during business hours (8 hours a day) those costs are 1/3rd or less (no weekends)

 


@ me in replies or I'll lose your thread!!!
Instead of a Kudo, please vote for this idea
Become an expert!: Enterprise DNA
External Tools: MSHGQM
YouTube Channel!: Microsoft Hates Greg
Latest book!:
Mastering Power BI 2nd Edition

DAX is easy, CALCULATE makes DAX hard...

Helpful resources

Announcements
Fabric Community Conference

Microsoft Fabric Community Conference

Join us at our first-ever Microsoft Fabric Community Conference, March 26-28, 2024 in Las Vegas with 100+ sessions by community experts and Microsoft engineering.

February 2024 Update Carousel

Power BI Monthly Update - February 2024

Check out the February 2024 Power BI update to learn about new features.

Fabric Career Hub

Microsoft Fabric Career Hub

Explore career paths and learn resources in Fabric.

Fabric Partner Community

Microsoft Fabric Partner Community

Engage with the Fabric engineering team, hear of product updates, business opportunities, and resources in the Fabric Partner Community.