Forum Discussion

Arnab0111's avatar
Arnab0111
Icon for Helper I rankHelper I
3 years ago
Solved

Save a pyspark dataframe in a table in warehouse using notebook

I am using notebook and have a pyspark dataframe , please guide me in saving the same as a overwrite mode table in warehouse inside a custom schema.
  • puneetvijwani's avatar
    3 years ago

    Arnab0111 Would suggest if you can navigate to data enginnering space from bottom left and go to Use sample section ,you will see the data engeering starter kit , it has many examples from writing t& transformation which will guide you how you can save table as default in Table section in a Lakehouse and data prep from data engineering point of view , which will save the table in default catalog of lakehouse 

    After that Open the Data warehouse and add your Lakehouse sql end point 

     


    Query the DBO Schema table from lakehouse and save as view in to your Custom Schma of your data warehouse