How Copy files/tables from lakehouse to another lakehouse in other workpace?

[Matces]

Hi!

There is a way to copy files/tables from lakehouse to another lakehouse in other workspace?

[joeguicearnold]

This seems like a perfect application of Shortcuts.  No need for a true copy of the data as both Files or Tables work as if they are native in the 2nd Lakehouse.

[Matces]

thanks @Anonymous 

[NandanHegde · Accepted solution]

Hey,

There are multiple ways to transfer data/files between 2 different lakehouses  via :

1) Python code as stated by @Anonymous 

2) You can use Azure data factory/Synapse pipelines :

where your source and sink can ben lakehouses

But it is currenly not possible via Fabric data pipelines

[HimanshuS-msft]

Hello @Matces , 

Just to add what @Anonymous  said above .

I am not sure how big is the dataset but as a work around you can copy the file/tables  from one WS to a storage location using data flow ot pipeline and the  from there you can to the siderent WS . 

You can use the data flows or pipelines : https://learn.microsoft.com/en-us/fabric/data-factory/transform-data

Thanks 
Himanshu 

[Anonymous]

Hi @Matces 
You can copy the data present in one lakehouse in Workspace A to another lakehouse in Workspace B in the following way by using Notebooks:
I have a table named publicholidays in Workspace A. Using it as source I created another table in Workspace B by using the below code:

source = "abfss://*****.Lakehouse/Tables/publicholidays"
dest = "Tables/test"
df = spark.read.format("delta").load(source)
df.write.mode("overwrite").format("delta").save(dest)

In the above code replace source with the abfss path of Workspace A.  You can get the abfss path like shown below:

You should add the destination lakehouse present in Workspace B as the default lakehouse in the notebook and run the above code. The table will be successfully created in workspace B.

Hope this helps. Please let me know if you have further queries.

[chcg]

This works if you don't want your target tables within a schema.

If you do then I find you get the Unidentified schema and the tables are not deltas, they are instead files?

Has anyone found a way to copy from one lakehouse to another within schemas using a python notebook?

[Anonymous]

Hi  @Matces 
Thanks for using Fabric Community. Apologies for the delay in response.
Copying files/tables directly from one workspace to another in Microsoft Fabric is currently not possible due to security restrictions. The isolation between workspaces prevents direct cross-workspace access.

Help us prioritize this feature! You can post your idea on the ideas site or cast a vote on an existing idea. Below is the link to the ideas site.

https://aka.ms/FabricIdeas

Hope this helps. Please let me know if you have any further questions.

[Anonymous]

Hi @Matces 
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. Otherwise, will respond back with the more details and we will try to help.
Thanks