Starting December 3, join live sessions with database experts and the Microsoft product team to learn just how easy it is to get started
Learn moreGet certified in Microsoft Fabric—for free! For a limited time, get a free DP-600 exam voucher to use by the end of 2024. Register now
Hey, I have taken 60day trail for the fabric,
created the table using spark notebook here is the code I have used.
df.write.mode("overwrite").format("delta").saveAsTable("Salesforce_lead_full")
it shows up in the lakehouse
but refuses to show up in the sql end point or in the model so that i can use this dataset in powerbi to make something out of it.
other interesting thing is when i click on properties of the table I see blank value in the Format field
and i can see the table files in the one lake file explorer. waited for 2 days now and its been killing me. we are doing a POC of fabric so far its been super buggy.
please help
Solved! Go to Solution.
If you created your Lakehouse with the schemas (preview) enabled, then the SQL Analytics Endpoint won't work. Please ref. these docs: Lakehouse schemas (Preview) - Microsoft Fabric | Microsoft Learn
Please try to create your Lakehouse without the schemas (keep that option unchecked).
If you created your Lakehouse with the schemas (preview) enabled, then the SQL Analytics Endpoint won't work. Please ref. these docs: Lakehouse schemas (Preview) - Microsoft Fabric | Microsoft Learn
Please try to create your Lakehouse without the schemas (keep that option unchecked).
Thanks a ton, that worked. I have been banging my head for 2 days now.
Hi @sun-sboyanapall ,
Thanks for @AndyDDC 's prompt reply, you can try his suggestion first.
I have some suggestions for your problem as well. The issue you are experiencing could be due to a number of reasons, the SQL Analytics Endpoint cache may not be updated in a timely manner. Try refreshing or reconnecting to see the newly added tables. And data synchronisation may take some time. Wait for a few minutes and check again.
If the above methods still didn't help you solve the problem, you can consider clearing the cache and re-adding the new table, then refresh it to see if the new table is loaded in SQL Analytics Endpoint.
Best Regards,
Ada Wang
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
I have actually tried all of this from other posts but it was that checkmark that was the issue in my case.
hi @sun-sboyanapall @can you try writing using:
df.write.mode("overwrite").format("delta").save("Tables/Salesforce_lead_full")
This was my issue - I have a custom function which writes dataframes to delta tables, and it was working, showing up as a table in my lakehouse and as a file in my lakehouse - what it wasn't doing was actually creating a table in my SQL endpoint "warehouse", writing it like this ,made it visible in my lakehouse sql endpoint schema.
User | Count |
---|---|
5 | |
4 | |
4 | |
4 | |
1 |
User | Count |
---|---|
14 | |
12 | |
9 | |
9 | |
4 |