Fabric Notebook with a default lakhouse (Silver) and another lakehouse mounted (Gold)

[DebbieE]

I am creating a dataframe with data from silver lakehouse so this is the default one. dev_silver_lk

But I want to create a dimension Delta Parquet file in the gold lakehouse dev_gold_lk

I have also mounted this Data lake to the notebook (They both are in public preview as I have Schemas ticked)

And I just cant seem to do it? 

Surely this should be possible? 

I suspect it might be because my Lakehouse has Preview schemas? I tried this and it didnt work in Pyspark Notebook

gold_lh = "dev_timesheet_gold_lh"

target_path = gold_lh + "/Tables/dimCustomer"

from delta.tables import DeltaTable

dfBlockersKey_reordered.write.format("delta").mode("overwrite").save(target_path)

But I just get Py4JJavaError: An error occurred while calling o17332.save. : Operation failed: "Bad Request", 400, HEAD,

[DebbieE]

I have given up on Lakehouse with Schema enabled. Another fail for me right now

[v-nmadadi-msft]

Hi @DebbieE 

As we haven’t heard back from you, we wanted to kindly follow up to check if the solution provided by the community members for the issue worked. If our response addressed, please mark it as Accept as solution and click Yes if you found it helpful.

Thanks and regards

[v-nmadadi-msft]

Hi @DebbieE 

I wanted to check if you had the opportunity to review the information provided. Please feel free to contact us if you have any further questions. If our responses has addressed your query, please accept it as a solution and give a 'Kudos' so other members can easily find it.

Thank you.

[v-nmadadi-msft]

Hi @DebbieE 

May I ask if you have resolved this issue? If so, please mark the helpful reply and accept it as the solution. This will be helpful for other community members who have similar problems to solve it faster.

Thank you.

[PanuO]

Try providing full ABFSS path:

DELTA_TABLE_PATH = "abfss://(workspace id)@onelake.dfs.fabric.microsoft.com/(lakehouse id)/Tables/(tablename)"

delta_table = DeltaTable.forPath(spark, DELTA_TABLE_PATH)
...

[v-nmadadi-msft · Accepted solution]

Hi @DebbieE  ,
Thanks for reaching out to the Microsoft fabric community forum.

Currently Lakehouse with schema enabled have some limitations as they are still in public preview,

source: Lakehouse schemas (Preview) - Microsoft Fabric | Microsoft Learn

Please try performing the operation with schemas disabled to see if the issue still occurs.


If this post helps, then please consider Accepting as solution to help the other members find it more quickly and consider giving a KUDOS. Feel free to reach out if you need further assistance.
Thank you

[Liam_McCauley]

You could try saveAsTable:

dfBlockersKey_reordered.write \
    .format("delta") \
    .mode("overwrite") \
    .saveAsTable("dev_timesheet_gold_lh.dimCustomer")