Forum Discussion

pushpanth's avatar
pushpanth
New Member
5 months ago

Lakehouse is not in sync with SQL endpoint

Hi All, 

 

From past two days we are experiencing the lakehouse -SQL analytics endpoint sync issues, with out any errors. wanted to check if anyone are also experiencing the same behaviour?

data engineering
Lakehouse

3 Replies

  • smeetsh's avatar
    smeetsh
    Continued Contributor
    5 months ago

    Yes sadly this is a known issue. there is a sempy labs package you can run in a notebook, to force the synch, if you don't want to do this, the following (no code solution) works to:

     

    After your ingest into the lakehosue run a dummy script (select top 10 * from your lakehouse table name), next put in a wait step ( we use a 5 minutes delay, but you may get away with shorter, experimentation will be your friend here 🙂 )

     

    It is a very annoying issue that has been going on for 1,5 years or more by now.  MS prefers you to use the API call to force refresh, but that requires coding and also, it checks the refresh status of ALL tables in your lakehouse.

     

    For the sempy labs package, please see below:
    Code Examples · microsoft/semantic-link-labs Wiki

    • V-yubandi-msft's avatar
      V-yubandi-msft
      Community Support
      5 months ago

      Hi pushpanth ,

      The guidance shared by smeetsh  is valid and aligns with the current recommendations. If you need any additional details or clarification, please let us know.

       

      Thank you for your response smeetsh .

       

       

       

  • V-yubandi-msft's avatar
    V-yubandi-msft
    Community Support
    5 months ago

    Hi pushpanth ,

    We haven’t received a response from your end yet. Please let us know whether the issue has been resolved or if you’re still facing any difficulties. Feel free to reach out if you need further assistance.

     

    Yugandhar.