Forum Discussion

FelixL's avatar
FelixL
Advocate II
2 years ago
Solved

Delayed data refresh in SQL Analytical Endpoint

I am currently working on moving from Synapse Serverless SQL to Fabric SQL Analytical Endpoint for reading my external Delta Lake tables (Managed and updated in Azure Synapse, and linked to Fabric La...
data engineering
one lake
power bi
  • AndyDDC's avatar
    AndyDDC
    2 years ago

    So my info from Microsoft is that it should take a few seconds to a minute for the SQL Endpoint to discover the updated delta logs.  They did have an issue which was fixed apparently.

     

    If your issue persists it would be worth logging that with MS support and give them you workspace ID, lakehouse id, and time it was happening

Muru_fabric's avatar
Muru_fabric
New Member
1 year ago

Hello All, 

i am also facing an same issue. Store Procedure  are processing stale data from the lake house since there appears to be a delay between the completion of the notebooks and the data being fully available in the DW. As suggested by Microsoft support, introduced a 'wait' activity in the pipeline to try and overcome this problem. we could see that problem is wait time is less than 30 min.

 

any long term solution such as to use Direct Lake Semantic Models in Power BI, instead of SQL endpoint ?

 

any suggestions ?

 

Regards,

Murugan