Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
1 year ago
Solved

Write df to DataWarehouse tables

can someone show me how to write a dataframe df to a table in a Warehouse in Fabric? I try below code, but having issue... I suppose there is no username or password involved here:   from pyspark...
data engineering
  • nilendraFabric's avatar
    nilendraFabric
    1 year ago

     

    hello Anonymous 

     

     

    Prepare the JDBC URL with the correct endpoint, database name, encryption, and authentication

    dw_url = (“jdbc:sqlserver://<your_server_identifier>.datawarehouse.fabric.microsoft.com:1433;”
“DatabaseName=WideWorldImportersDW;”
“encrypt=true;”
“Authentication=ActiveDirectoryPassword”)

     


    Provide authentication details in the connection properties
    dw_properties = {
“driver”: “com.microsoft.sqlserver.jdbc.SQLServerDriver”,
“user”: “[email protected]”,“password”: “your_password” 
}

     


    Write the DataFrame to the target table in the Data Warehouse
    df.write.jdbc(url=dw_url, table=“dbo.Employee”, mode=“overwrite”, properties=dw_properties)

nilendraFabric's avatar
nilendraFabric
Super User
1 year ago

 

hello Anonymous 

 

 

Prepare the JDBC URL with the correct endpoint, database name, encryption, and authentication

dw_url = (“jdbc:sqlserver://<your_server_identifier>.datawarehouse.fabric.microsoft.com:1433;”
“DatabaseName=WideWorldImportersDW;”
“encrypt=true;”
“Authentication=ActiveDirectoryPassword”)

 


Provide authentication details in the connection properties
dw_properties = {
“driver”: “com.microsoft.sqlserver.jdbc.SQLServerDriver”,
“user”: “[email protected]”,“password”: “your_password” 
}

 


Write the DataFrame to the target table in the Data Warehouse
df.write.jdbc(url=dw_url, table=“dbo.Employee”, mode=“overwrite”, properties=dw_properties)