Forum Discussion
Solved
Error reading datawarehouse table in a notebook using pyspark python
I am very frustrated as I developed an integration that was working reading data from the DW in a notebook (python) that basicaly gets the rows from a DW table and send it to an API, now it is broken...
This works for me:
Replace the Workspace name and Warehouse name with their GUID's (you can find them in the URL in the web browser when you are inside your Warehouse).
Like this:
abfss://<workspaceID>@onelake.dfs.fabric.microsoft.com/<warehouseID>/Tables/<schemaName>/<tableName>
Hi RafaelTerzoni,
I made a test setup to see the abfss path of a table in a warehouse. It seems to me that you do not need the schema before the table name. In your case, mrq.Contact should become Contact. The schema does need to be in the path, but you already have that, so it seems.
Your full path from your example would become (where I suppose mrq is the schema):
delta_table_path = "abfss://[email protected]/MRQ_Int.datawarehouse/Tables/mrq/Contact"
This doesn't work for me.
I tried this:
df_wh = spark.read.load("abfss://<workspaceName>@onelake.dfs.fabric.microsoft.com/<warehouseName>.datawarehouse/Tables/<schemaName>/<tableName>")It gives me 400 Bad Request.It worked when I replaced <workspaceName> with the ID of the workspace, and replaced the <warehouseName>.datawarehouse with the ID of the warehouse.