Please fix the SQL Analytics Endpoint sync delays.
Many users have been surprised and are receiving old data because of the Lakehouse SQL Analytics Endpoint sync delays.
We want Fabric to handle this automatically, so we don't need to think about it.
5 Comments
Would it be possible to delay committing data to the lakehouse until the SQL endpoint sync is complete? Or introduce a new transaction isolation level where the user can choose to wait for the endpoint to be sync'd.
- Status added:New
- If the sync delay can't be eliminated, then I suggest adding a Data Factory task that can wait on sync completion. Otherwise if you try to implement a pattern of loading to a lakehouse and then bringing data to a warehouse using the SQL endpoint, you risk failure or incorrect results due to the sync not being completed.
- Absolutely! Fixing SQL Analytics Endpoint sync delays would ensure users always see up-to-date data and remove the need for manual intervention.
- Meta refresh is still slow and sometimes unreliable. Fixing this should be a priority. This needs to be seamless and not something users have to know about similar to competing platforms like Databricks.
