topic Re: Tables Not Appearing In Lakehouse But are visible on my Notebook Resource Lakehouse in Pipelines

Tables Not Appearing In Lakehouse But are visible on my Notebook Resource Lakehouse

WilliamMunguti — Fri, 08 Nov 2024 10:04:47 GMT

Hello,

I require some asssictance on how to go about this issue. So I was fetchig data from an api and did some cleaning on a notbook. I want to store the data in a table in my lakehouse. The issue is the table successfuly creates on my notebook lakhouse environment, but they don't appear in my lakehouse. How can I go about this? I require some assittance please.

The table you see on lakehouse, I had to create that manually from a parquet file that I had saved in the files directory.

Re: Tables Not Appearing In Lakehouse But are visible on my Notebook Resource Lakehouse

spencer_sa — Fri, 08 Nov 2024 10:17:10 GMT

A couple of points

Firstly there is a delay between a notebook creating a table and that table appearing in the SQL Analytics endpoint. (There are a few topics on this)

Secondly, sometimes the SQL Analytics endpoint needs refreshing (icon near the top left of the pane) before new tables appear in the list on the left.

Re: Tables Not Appearing In Lakehouse But are visible on my Notebook Resource Lakehouse

SudhavaniKolla3 — Mon, 11 Nov 2024 10:04:41 GMT

Hi, the first image which you have showcased is SQL end point. so in SQL end point, if the table is in delta paqrue format ( a table symbol with triangle shape), then only it will show, otherwise, it wont show in SQL end point, but even thoigh its not delta parquet format, will show in lakehouse, that is the reson, u are unable see the tables in SQL end point

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Re: Tables Not Appearing In Lakehouse But are visible on my Notebook Resource Lakehouse

SudhavaniKolla3 — Mon, 11 Nov 2024 10:04:53 GMT

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Re: Tables Not Appearing In Lakehouse But are visible on my Notebook Resource Lakehouse

WilliamMunguti — Mon, 18 Nov 2024 15:26:08 GMT

Hi Thanks for the response. Actualy the reason was that the tables was being created in the default lakehouse and not lakhouse url I was pointing it to using the url. It eventually worked okay when I figured out I had to change the default lakhouse to the one I wanted to store in

Re: Tables Not Appearing In Lakehouse But are visible on my Notebook Resource Lakehouse

WilliamMunguti — Mon, 18 Nov 2024 15:27:10 GMT

Thanks. I noticed this as well 👍