Starting December 3, join live sessions with database experts and the Microsoft product team to learn just how easy it is to get started
Learn moreGet certified in Microsoft Fabric—for free! For a limited time, get a free DP-600 exam voucher to use by the end of 2024. Register now
Hi!
There is a way to copy files/tables from lakehouse to another lakehouse in other workspace?
Solved! Go to Solution.
Hey,
There are multiple ways to transfer data/files between 2 different lakehouses via :
1) Python code as stated by @v-nikhilan-msft
2) You can use Azure data factory/Synapse pipelines :
where your source and sink can ben lakehouses
But it is currenly not possible via Fabric data pipelines
This seems like a perfect application of Shortcuts. No need for a true copy of the data as both Files or Tables work as if they are native in the 2nd Lakehouse.
Hey,
There are multiple ways to transfer data/files between 2 different lakehouses via :
1) Python code as stated by @v-nikhilan-msft
2) You can use Azure data factory/Synapse pipelines :
where your source and sink can ben lakehouses
But it is currenly not possible via Fabric data pipelines
Hello @Matces ,
Just to add what @v-nikhilan-msft said above .
I am not sure how big is the dataset but as a work around you can copy the file/tables from one WS to a storage location using data flow ot pipeline and the from there you can to the siderent WS .
You can use the data flows or pipelines : https://learn.microsoft.com/en-us/fabric/data-factory/transform-data
Thanks
Himanshu
Hi @Matces
You can copy the data present in one lakehouse in Workspace A to another lakehouse in Workspace B in the following way by using Notebooks:
I have a table named publicholidays in Workspace A. Using it as source I created another table in Workspace B by using the below code:
source = "abfss://*****.Lakehouse/Tables/publicholidays"
dest = "Tables/test"
df = spark.read.format("delta").load(source)
df.write.mode("overwrite").format("delta").save(dest)
In the above code replace source with the abfss path of Workspace A. You can get the abfss path like shown below:
You should add the destination lakehouse present in Workspace B as the default lakehouse in the notebook and run the above code. The table will be successfully created in workspace B.
Hope this helps. Please let me know if you have further queries.
Hi @Matces
Thanks for using Fabric Community. Apologies for the delay in response.
Copying files/tables directly from one workspace to another in Microsoft Fabric is currently not possible due to security restrictions. The isolation between workspaces prevents direct cross-workspace access.
Help us prioritize this feature! You can post your idea on the ideas site or cast a vote on an existing idea. Below is the link to the ideas site.
Hope this helps. Please let me know if you have any further questions.
Hi @Matces
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. Otherwise, will respond back with the more details and we will try to help.
Thanks
Starting December 3, join live sessions with database experts and the Fabric product team to learn just how easy it is to get started.
Check out the November 2024 Fabric update to learn about new features.
User | Count |
---|---|
21 | |
16 | |
8 | |
7 | |
6 |