Forum Discussion
Problem to import on premise data onto a lakehouse using a DataflowGen2
- 2 years ago
Hi alfBI
Thanks for using Microsoft Fabric Community.
As I understand that you are trying to load data from an on premise SQL Server onto a Fabric lakehouse using a Dataflow Gen2.
In scenarios where your data sources are located on-premises, Microsoft provides the On-Premises Data Gateway to securely bridge the gap between your on-premises environment and the cloud. This document will guide you through the process of accessing on-premises data sources within Data Factory for Microsoft Fabric using the On-Premises Data Gateway.
For more details please refer to the below mentioned links:
Install an on-premises data gateway.
How to access on-premises data sources in Data Factory for Microsoft Fabric.
On-premises data gateway considerations for data destinations in Dataflow Gen2.
I hope this information is helpful. Please do let us know if you have any queries.
We upgraded to latest gateway release (3000.198.17) and problem remained. Problem was fixed removing the proxy and reviewing the outpbound request. We noticed that por 1433 was not not allowed for *.datawarehouse.pbidedicated.windows.net. Once added everything worked finally
Anyway I have the feeling that documentation about the list of FDQN used on the gateway
https://learn.microsoft.com/en-us/data-integration/gateway/service-gateway-communication
should be improved as we have to add additional URLs to the proxy white list
* .analysis.windows.net
*. applicationinsights.azure.com
*.data.microsoft.com
*.dfs.fabric.microsoft.com
Thx for your support
- dazhang2 years ago
Microsoft Employee
Hi alfBI, thanks for the details, sorry for the delay.
For the endpoints you listed:
- *.analysis.windows.net - this is already included in the documentation
- *.applicationinsights.azure.com - our documentation includes *.dc.services.visualstudio.com which is for Application Insights, did you already try adding this?
- *.data.microsoft.com - can you give more details on where you see this is needed?
- *.dfs.fabric.microsoft.com - we just added this to the documentation, thanks for calling it out.
Thanks,
David