Forum Discussion

MOVC's avatar
MOVC
Icon for Resolver I rankResolver I
2 years ago

Missing Field in Warehouse

I'm having a problem that probably has a simple solution but I can't see it.   I had a table in a warehouse that I dropped and recreated to add an extra field (RecipientSentDateTime) and then repop...
data warehouse
Anonymous's avatar
Anonymous
Not applicable
2 years ago

Hi MOVC 
Thanks for using Fabric Community. Apologies for the issue you have been facing.
This error is due to an existing Known Issue with the Warehouse.  If you use a SQL analytics endpoint that hasn't been active for a while, the SQL analytics endpoint scans the underlying delta tables. It's possible for you to query one of the tables before the refresh is completed with the latest data. If so, you might see old data being returned or even errors being raised if the parquet files were vacuumed.

For more information regarding this issue please refer to this link:
Known issue - Using an inactive SQL analytics endpoint can show old data - Microsoft Fabric | Microsoft Learn

Hope this helps. Please let me know if you have any further queries.

MOVC's avatar
MOVC
Icon for Resolver I rankResolver I
2 years ago

Thank you for the response.

 

I'm not sure about "hasn't been active for a while" since I created the warehouse on Monday but it does appear to be related to what we're seeing. But I haven't touched any Warehouse objects or rerun my pipeline for 24 hours now and I'm still having the same problem. The page says "You can retry after allowing the SQL analytics endpoint to complete its refresh process.", how long is this expected to take?

  • Anonymous's avatar
    Anonymous
    Not applicable
    2 years ago

    Hi MOVC 
    Currently we do not have any information regarding the wait time. I would request you to create a support ticket to understand the root cause for this issue.
    Please create a support ticket at the below link:
    https://support.fabric.microsoft.com/en-US/support/
    Please share the details of the link here. This will help us for internal tracking.
    Thanks

    • Anonymous's avatar
      Anonymous
      Not applicable
      2 years ago

      Hi MOVC 
      We haven’t heard from you on the last response and was just checking back to see if you got a chance to create a support ticket. If yes please provide the details here. Otherwise, will respond back with the more details and we will try to help.
      Thanks