Join us at FabCon Atlanta from March 16 - 20, 2026, for the ultimate Fabric, Power BI, AI and SQL community-led event. Save $200 with code FABCOMM.
Register now!Calling all Data Engineers! Fabric Data Engineer (Exam DP-700) live sessions are back! Starting October 16th. Sign up.
Hi
I need to connect the powerBI service to onprem with a on prem data gateway, i have expressroute with private peering, and need to access data source onprem, how can i do? i cannot find doc on this topic.
The on prem data gateway will be installed on azure vm
thank you
Solved! Go to Solution.
Hi @aresblade
To connect the Power BI Service to your on-premises data source using the On-premises Data Gateway in a setup that includes ExpressRoute with private peering, you can follow a slightly adjusted approach. Even though your data source is on-prem, you're planning to install the gateway on an Azure VM, which is a valid and common architecture—especially when the Azure VM is connected to your on-prem network via ExpressRoute. In this setup, the gateway VM acts as a bridge between the Power BI Service (cloud) and your on-prem resources (databases, files, etc.) via the private ExpressRoute path. Here's how it works: the On-premises Data Gateway, once installed on the Azure VM, initiates outbound connections to the Microsoft Azure Service Bus over HTTPS (port 443). It does not require inbound ports to be open, making it firewall-friendly. As long as the Azure VM can reach your on-prem data source through the ExpressRoute private peering (e.g., SQL Server, SAP, etc.), the Power BI Service will be able to send queries through the gateway to fetch data. Just make sure the gateway VM can resolve and access the on-prem IPs/DNS names correctly. Although documentation is sparse for this specific hybrid setup (Azure-hosted gateway + on-prem ExpressRoute access), it follows the same principles as any on-prem installation—just ensure your ExpressRoute configuration allows traffic from the Azure VM subnet to the on-prem network. Register the gateway in Power BI Service, map it to your data source, and configure scheduled refreshes or DirectQuery as needed.
Hi @aresblade
To connect the Power BI Service to your on-premises data source using the On-premises Data Gateway in a setup that includes ExpressRoute with private peering, you can follow a slightly adjusted approach. Even though your data source is on-prem, you're planning to install the gateway on an Azure VM, which is a valid and common architecture—especially when the Azure VM is connected to your on-prem network via ExpressRoute. In this setup, the gateway VM acts as a bridge between the Power BI Service (cloud) and your on-prem resources (databases, files, etc.) via the private ExpressRoute path. Here's how it works: the On-premises Data Gateway, once installed on the Azure VM, initiates outbound connections to the Microsoft Azure Service Bus over HTTPS (port 443). It does not require inbound ports to be open, making it firewall-friendly. As long as the Azure VM can reach your on-prem data source through the ExpressRoute private peering (e.g., SQL Server, SAP, etc.), the Power BI Service will be able to send queries through the gateway to fetch data. Just make sure the gateway VM can resolve and access the on-prem IPs/DNS names correctly. Although documentation is sparse for this specific hybrid setup (Azure-hosted gateway + on-prem ExpressRoute access), it follows the same principles as any on-prem installation—just ensure your ExpressRoute configuration allows traffic from the Azure VM subnet to the on-prem network. Register the gateway in Power BI Service, map it to your data source, and configure scheduled refreshes or DirectQuery as needed.
Hi @aresblade,
Thank you for reaching out to Microsoft Fabric Community.
Thank you @sergej_og for the prompt response.
As we haven’t heard back from you, we wanted to kindly follow up to check if the solution provided by the user resolved your issue? or let us know if you need any further assistance.
If any response resolved your issue, please mark it as "Accept as solution" and click "Yes" if you found it helpful.
Thanks and regards,
Anjan Kumar Chippa
Hi @aresblade,
We wanted to kindly follow up to check if the solution provided by the user resolved your issue.
If any response resolved your issue, please mark it as "Accept as solution" and click "Yes" if you found it helpful.
Thanks and regards,
Anjan Kumar Chippa
Hi @aresblade,
As we haven’t heard back from you, we wanted to kindly follow up to check if the solution provided by the user resolved your issue?
If any response resolved your issue, please mark it as "Accept as solution" and click "Yes" if you found it helpful.
Thanks and regards,
Anjan Kumar Chippa
- You need to install the gateway client first.
Pls keep the recovery key in a safe place. Coulb be very heplful.
- After a successful installation you can register your gateway to you PBI Service tenant.
- Make sure you have the right FW-rules for your azure vm (where gateway client is sitting) to access your on-prem sources.
- Create connections to your sources within your Service tenant in the "Manage Conncetions and gateways" section to be able to refresh your data in Service.
Try this approach.
Regards
Join the Fabric FabCon Global Hackathon—running virtually through Nov 3. Open to all skill levels. $10,000 in prizes!
Check out the September 2025 Power BI update to learn about new features.