Forum Discussion

MOVC's avatar
MOVC
Icon for Resolver I rankResolver I
2 years ago

Missing Field in Warehouse

I'm having a problem that probably has a simple solution but I can't see it.

 

I had a table in a warehouse that I dropped and recreated to add an extra field (RecipientSentDateTime) and then repopulated with a pipeline, but I cannot see the new field in the live connection (see screenshots). If I connect via the SQL Endpoint in Power BI Desktop I can see it but not by the default connection.

 

Any ideas? Seems like something needs to be done to update the schema?

data warehouse

4 Replies

  • Anonymous's avatar
    Anonymous
    Not applicable
    2 years ago

    Hi MOVC 
    Thanks for using Fabric Community. Apologies for the issue you have been facing.
    This error is due to an existing Known Issue with the Warehouse.  If you use a SQL analytics endpoint that hasn't been active for a while, the SQL analytics endpoint scans the underlying delta tables. It's possible for you to query one of the tables before the refresh is completed with the latest data. If so, you might see old data being returned or even errors being raised if the parquet files were vacuumed.

    For more information regarding this issue please refer to this link:
    Known issue - Using an inactive SQL analytics endpoint can show old data - Microsoft Fabric | Microsoft Learn

    Hope this helps. Please let me know if you have any further queries.

    • MOVC's avatar
      MOVC
      Icon for Resolver I rankResolver I
      2 years ago

      Thank you for the response.

       

      I'm not sure about "hasn't been active for a while" since I created the warehouse on Monday but it does appear to be related to what we're seeing. But I haven't touched any Warehouse objects or rerun my pipeline for 24 hours now and I'm still having the same problem. The page says "You can retry after allowing the SQL analytics endpoint to complete its refresh process.", how long is this expected to take?

      • Anonymous's avatar
        Anonymous
        Not applicable
        2 years ago

        Hi MOVC 
        Currently we do not have any information regarding the wait time. I would request you to create a support ticket to understand the root cause for this issue.
        Please create a support ticket at the below link:
        https://support.fabric.microsoft.com/en-US/support/
        Please share the details of the link here. This will help us for internal tracking.
        Thanks