topic How Copy files/tables from lakehouse to another lakehouse in other workpace? in Pipelines

How Copy files/tables from lakehouse to another lakehouse in other workpace?

Matces — Sun, 18 Feb 2024 12:58:32 GMT

Hi!

There is a way to copy files/tables from lakehouse to another lakehouse in other workspace?

Re: How Copy files/tables from lakehouse to another lakehouse in other workpace?

Anonymous — Tue, 20 Feb 2024 16:18:40 GMT

Hi Matces
Thanks for using Fabric Community. Apologies for the delay in response.
Copying files/tables directly from one workspace to another in Microsoft Fabric is currently not possible due to security restrictions. The isolation between workspaces prevents direct cross-workspace access.

Help us prioritize this feature! You can post your idea on the ideas site or cast a vote on an existing idea. Below is the link to the ideas site.

https://aka.ms/FabricIdeas

Hope this helps. Please let me know if you have any further questions.

Re: How Copy files/tables from lakehouse to another lakehouse in other workpace?

HimanshuS-msft — Tue, 20 Feb 2024 18:02:57 GMT

Hello Matces ,

Just to add what Anonymous said above .

I am not sure how big is the dataset but as a work around you can copy the file/tables from one WS to a storage location using data flow ot pipeline and the from there you can to the siderent WS .

You can use the data flows or pipelines : https://learn.microsoft.com/en-us/fabric/data-factory/transform-data

Thanks
Himanshu

Re: How Copy files/tables from lakehouse to another lakehouse in other workpace?

Anonymous — Tue, 20 Feb 2024 18:48:37 GMT

Hi Matces
You can copy the data present in one lakehouse in Workspace A to another lakehouse in Workspace B in the following way by using Notebooks:
I have a table named publicholidays in Workspace A. Using it as source I created another table in Workspace B by using the below code:

source = "abfss://*****.Lakehouse/Tables/publicholidays" dest = "Tables/test" df = spark.read.format("delta").load(source) df.write.mode("overwrite").format("delta").save(dest)

In the above code replace source with the abfss path of Workspace A. You can get the abfss path like shown below:

You should add the destination lakehouse present in Workspace B as the default lakehouse in the notebook and run the above code. The table will be successfully created in workspace B.

Hope this helps. Please let me know if you have further queries.

Re: How Copy files/tables from lakehouse to another lakehouse in other workpace?

NandanHegde — Wed, 21 Feb 2024 05:06:04 GMT

Hey,

There are multiple ways to transfer data/files between 2 different lakehouses via :

1) Python code as stated by Anonymous

2) You can use Azure data factory/Synapse pipelines :

where your source and sink can ben lakehouses

But it is currenly not possible via Fabric data pipelines

Re: How Copy files/tables from lakehouse to another lakehouse in other workpace?

Anonymous — Thu, 22 Feb 2024 14:57:32 GMT

Hi Matces
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. Otherwise, will respond back with the more details and we will try to help.
Thanks

Re: How Copy files/tables from lakehouse to another lakehouse in other workpace?

Matces — Thu, 22 Feb 2024 15:54:14 GMT

thanks Anonymous

Re: How Copy files/tables from lakehouse to another lakehouse in other workpace?

joeguicearnold — Tue, 08 Oct 2024 20:33:52 GMT

This seems like a perfect application of Shortcuts. No need for a true copy of the data as both Files or Tables work as if they are native in the 2nd Lakehouse.

Re: How Copy files/tables from lakehouse to another lakehouse in other workpace?

chcg — Wed, 12 Mar 2025 13:01:54 GMT

This works if you don't want your target tables within a schema.

If you do then I find you get the Unidentified schema and the tables are not deltas, they are instead files?

Has anyone found a way to copy from one lakehouse to another within schemas using a python notebook?