Lakehouse data show 2 different results between notebooks

[krisjones]

I have 2 separate notebooks with high concurreny sessions running.

Both have the omnis_silver_lh.instrument table.

In one notebook, it shows that I have data that I just inserted

In another notebooks it shows that the same omnis_silver_lh.instrument table has no data.

Also, the omnis_silver_lh.instrument table view in the Lakehouse shows no data

How can this be??

I logged out, logged in, stopped both sessions and restarted etc etc.

[krisjones · Accepted solution]

The problem turned out to be that the default Lakehouse dictates what the Spark catalog can see. 

So when I was updating what I thought was omnis_silver_lh in workspace B, it was actually updating it in workspace A. 

In the second screenshot, when I list all the databases in the spark catalog it lists the ones from workspace A because the default lakehouse is omnis_bronze_lh which is in workspace A.

In the first screenshot, when I switched the default lakehouse so now it's omnis_silver_lh2 and list the databases in the spark catalog, it shows the ones from workspace B. 

This is super confusing

 

[AntoineW]

If you just added data, it can be a sync time between artifacts.

Try to refresh lakehouse on the top rubban, then in each notebooks also, refresh lakehouse tables by clicking in the 3 dots > Refresh : 

Hope it can help you !

Antoine

[krisjones]

I've tried all that and I waited an hour.

[AntoineW]

Still have an issue ? 

You can raise a ticket to Microsoft Teams to contact the support for your issue.