Forum Discussion
Lakehouse data discrepancy between notebook and SQL endpoint or Dataflow
Sure, here are some screenshots. You can see that the Notebook returns zero rows, but when I view the data, there are more than 1000 records.
From the pictures, it looks like the table is a shortcut table.
I wouldn't know if that is relevant to the issue you are experiencing.
Do you know what is the source of the shortcut table? (aka Target of the shortcut).
Anyway, you say that you see the data when you connect from Dataflow Gen2. So it seems quite clear that the data is actually there. Just the Notebook don't find the data - that is the issue here.
Have you tried refreshing preview inside the Dataflow Gen2, or refresh the entire Dataflow Gen2, just to double check that the data is actually in the Lakehouse table?
Or clicked refresh in the user interface everywhere in the Lakehouse (both on Lakehouse level, table folder level, table level) and SQL Analytics Endpoint. There are quite many possible places to click refresh, almost a bit confusing.
Yes, the table is indeed a shortcut table. I have verified that the source table contains the expected data.
I have also created a notebook from the source and the same result
Just to confirm: notebook doesn't find the data also in the source table?
However other user interfaces finds the data also in the source table.
So the issue seems to be at the source table and notebook is not able to find the data, but other user interfaces are able to see the data.
That’s correct, the Notebook doesn’t show the data either. However, when using the SQL endpoint or Dataflow, the data is displayed correctly.