Forum Discussion
SQL endpoint lags behind lakehouse
Hi Anonymous ,
I would like to know you what is your method of importing data to lakehouse and changing data? Is it through Pipeline?
I see that some people are having the same problem as you:
Solved: SQL Endpoint Slow To Reflect Changes In Lakehouse - Microsoft Fabric Community
If you have any other questions please feel free to contact me.
Best Regards,
Yang
Community Support TeamIf there is any post helps, then please consider Accept it as the solution to help the other members find it more quickly.
If I misunderstand your needs or you still have problems on it, please feel free to let us know. Thanks a lot!How do you add columns?
Have you done other changes to the columns in the table?
As an example, enabling the Lakehouse table's column name mapping mode in a Notebook can cause the SQL Analytics Endpoint to stop syncing properly with the Lakehouse table.
I found this blog post that triggers the refresh of a lakehouse with a Python script. It works like a charm for me. I had the problem that the lakehouse had a lag of 30+ minutes. This Python script (which I used in a notebook) reduced it to 6 minutes and it waits until the sql endpoint is refreshed. So you are sure that other activities which are executed on completion of the Python notebook will have the refreshed sql endpoint.
https://www.obvience.com/blog/fix-sql-analytics-endpoint-sync-issues-in-microsoft-fabric-data-not-showing-heres-the-solution