Forum Discussion
Best Practice storage when using both sql and notebooks - warehouse or parquet
"i thought of making my stored procedure logic directly in the Lakehouse using notebooks as a kind of stored procedures (Spark SQL), and then invoking these whenever needed.
But i am unsure if this is a good idea?"
I think this is a good idea. Use Spark SQL and Lakehouse with Delta Table. Just try and see if it can solve your need. If it does, then I think this is the most efficient technology and a recommended way.
Please share if you stumble upon some specific roadblockers.
Remember to run OPTIMIZE and VACUUM at suitable intervals. In many cases, running OPTIMIZE and VACUUM once per day is a general okay solution. Depending on how often you make updates to the data tables.
You can now run T-SQL from fabric notebooks
https://learn.microsoft.com/en-us/fabric/data-engineering/author-tsql-notebook
you can attach your warehouse to notebook and run t-sql
I guess you can run stored procedures as well, you can give it a try
Need a Power BI Consultation? Hire me on Upwork
Connect on LinkedIn
|
Thanks for the reply and link.
It only shows how to make a simple query - not to execute a stored procedure. Do you know the syntax for calling a SP?
Further, i get a message on the DW: "This data source is not fully supported under the current global language." - Do you know what it means?
