Forum Discussion
Ingesting on premise data with notebooks
Hi Anonymous
Thanks for using Fabric Community.
Currently, Microsoft Fabric notebooks do not directly support connecting to on-premise databases through the Power BI Gateway. Fabric Spark doesn’t do the integration with PBI gateway.
As a workaround you can create a Shortcut in Fabric Lakehouse for your external data. This way you can query the data using Notebooks. For more information regarding Shortcuts please refer to this link:
https://learn.microsoft.com/en-us/fabric/onelake/create-onelake-shortcut
Hope this helps. Please let me know if you have any further queries.
How would shortcuts help me in this case? It can externally connect only to S3 and ADLS. The data is stored on local databases.
Hi Anonymous
Which database are you referring here? Can you please specify?Multiple local PG instances
Hi Anonymous
You should use a Data Pipeline to copy the data to lakehouse. Fabric data pipelines will be added to the On Prem data gateway in the next few months.
What's new and planned for Data Factory in Microsoft Fabric - Microsoft Fabric | Microsoft Learn
If you need something sooner, you should use Azure Data Factory Pipelines with the Self-Hosted Integration Runtime. For more information please refer to these links:
Copy on-premises data using the Azure Copy Data tool - Azure Data Factory | Microsoft Learn
How to ingest data into Fabric using the Azure Data Factory Copy activity - Microsoft Fabric | Microsoft Learn
Hope this helps. Please let me know if you have any further queries.