Forum Discussion
Lakehouse SQL endpoint
As my issue is ETL / pipeline related, neither of that helps.
What I did now as a soloution until MS releases the API which frithjof_v mentions, is to use the "unsupported script" to update SQL endpoints written by somone at MSFT found here:
What I did, if someone is interested to:
- Rewrote the script to be a bit more robust, with some error handling etc.
- Created it as a wheel, uploaded in a shared lakehouse, call it "own modules".
- Shortcuted into "own modules" in every lakehouse where a notebook updates the data & a sql endpoint needs a refresh.
- At end of each notebook which updates lakehouses, i run the script with error handling & logging, so if the unsupported APIs in the script gets changed/stops working, it won't affect the pipeline run, but I will know from logs.
- Wait for the official API to come.
Best regards,
Alexander
Hi p_da ,
Thank you for reaching out to the Microsoft Fabric community.
We are aware that the SQL Endpoint problem is impacting your work. Instead, we recommend using the Direct Lake.
Direct Lake enables the handling of large amounts of data efficiently. It loads delta tables stored as Parquet files in One Lake, the single storage for analytics data, into memory quickly. Thereafter, direct queries on its semantic model deliver high-performance queries. Direct Lake thereby eliminates slow, expensive data imports. This results in fast loading of data with frequent and quick refresh operations and optimizes capacity resources efficiently.
For more details, please refer to the attached official Microsoft documentation on Direct Lake. It provides comprehensive information to address your queries.
Link: Direct Lake overview - Microsoft Fabric | Microsoft Learn.
If my answer addressed your query, kindly mark it as the Accepted Solution to assist others.
I'd also be grateful for a 'Kudos' if you found my response useful!
Hi p_da ,
We noticed we haven't received a response from you yet, so we wanted to follow up and ensure the solution we provided addressed your issue. If you require any further assistance or have additional questions, please let us know.
Your feedback is valuable to us, and we look forward to hearing from you soon.
Thank You.