Notebook - Data Sources

Jothy — Fri, 02 Aug 2024 07:57:03 GMT

Hi Team,

From Fabric Notebook, we can see the possible data sources as Lakehouse alone. So can it have only Lakehouse as data source and no other sources like RDBMS or anyother sources/targets apart from lakehouse?

Re: Notebook - Data Sources

APG — Fri, 02 Aug 2024 09:46:36 GMT

In Fabric notebooks you are not limited to Lakehouses: actually you can write your own code to connect to other RDBMS; for example you can write a code snippet that connects to MySQL using jdbc

Re: Notebook - Data Sources

Anonymous — Mon, 05 Aug 2024 05:42:14 GMT

Hi @Jothy ,

Thanks for the reply from @APG .

Fabric Notebooks primarily supports data sources from Lakehouse, but it is not limited to them.

You can also connect to other data sources, including relational databases (RDBMS) and a variety of cloud and local sources.

The following is an example of connecting to an Azure SQL database using basic authentication:

# Placeholders for Azure SQL Database connection info server_name = "<your_server_name>.database.windows.net" database_name = "<your_database_name>" table_name = "<YourTableName>" db_username = "<username>" db_password = "<password>" # Build the Azure SQL Database JDBC URL jdbc_url = f"jdbc:sqlserver://{server_name}:1433;database={database_name};encrypt=true;trustServerCertificate=false;hostNameInCertificate=*.database.windows.net;loginTimeout=30;" # Properties for the JDBC connection properties = { "user": db_username, "password": db_password, "driver": "com.microsoft.sqlserver.jdbc.SQLServerDriver", } # Read entire table from Azure SQL Database using Basic authentication sql_df = spark.read.jdbc(url=jdbc_url, table=table_name, properties=properties) # Show the Azure SQL DataFrame sql_df.show()

Please see below for specific steps:

Connect to data with Spark - Training | Microsoft Learn

You may also want to check out this CASE that has similar needs to yours.

Solved: JDBC connection to Fabric Lakehouse SQL endpoint u... - Microsoft Fabric Community

If you have any other questions please feel free to contact me.

Best Regards,
Yang
Community Support Team

If there is any post helps, then please consider Accept it as the solution to help the other members find it more quickly.
If I misunderstand your needs or you still have problems on it, please feel free to let us know. Thanks a lot!

topic Re: Notebook - Data Sources in Data Engineering

Notebook - Data Sources

Re: Notebook - Data Sources

Re: Notebook - Data Sources