Forum Discussion

Srisakthi's avatar
Srisakthi
Super User
1 year ago
Solved

When to use T-SQL notebook

Hello All,   Can you please suggest on what scenario i should consider using T-SQL notebooks for transformations. 1. I have to use only If I have warehouse tables and i need to do transformations ...
Warehouse
  • AndyDDC's avatar
    AndyDDC
    1 year ago

    Hi Srisakthi IMHO T-SQL support in Notebooks is really for adhoc SELECT analysis over the Lakehouse SQL Endpoint.  I would not look do do any ETL/ELT code in Notebooks.

     

    So for me, I use it for analysis of data, not for loading/engineering (Lakehouse SQL Endpoint is read only, cannot write data using T-SQL).

     

    Hope that helps.

Anonymous's avatar
Anonymous
Not applicable
1 year ago

Hi Srisakthi,

#1, I think you can also use it to transform and show the temporary reuslt or save queries as view.

#2, I think dataflow or pipeline features should more suitable to push data from the Lakehouse. If you only use notebook, you may need to use some libraries and pyspark scripts to acheive these. (e.g. use mssparkutils and jdbc driver to write data from dataframe)

Solved: Re: Dataframe write to Warehouse through Notebook.... - Microsoft Fabric Community

Regards,

Xiaoxin Sheng