Copy Lakehouse and warehouse from prod to test workspace

[cw88]

Is there a way to copy a lakehouse/warehouse between worspaces. 

I my case i need a copy from warehouse and lakehouse from the production workspace in a test workspace - data and objects.

Thanks!

[cw88]

Does anyone have an idea how to get the data from warehouse from prod to test workspace? I need something like onprem "backup from prod database and restore on test server". 

[arpost]

I believe this would be addressed by the Data Warehouse in deployment pipelines feature (MS release plan link). Unfortunately, that was estimated to be released in Q4 2023; I've not heard that has happened yet and haven't seen any updates from Microsoft on this. ☹️

I just experimented with it, and this feature is actually available with deployment pipelines. That said, I tested it out and got a failure with my DW not deploying correctly. Data warehouses are listed as supported artifacts here (MS doc link), though.

[Anonymous]

Hello @cw88 ,

Thanks for using Fabric Community.
At this time, we are reaching out to the internal team to get some help on this .
We will update you once we hear back from them.

[Anonymous]

Hi @cw88 ,

Apologize for the delay in response. Currently we cannot copy the data with the help of deployment pipeline in Fabric, as these are not going to be copied.

In order to understand the supported items with deployment pipeline - The Microsoft Fabric deployment pipelines process - Microsoft Fabric | Microsoft Learn

Coming to your query, as an alternative method use DataFlow Gen 2 as it can connect to a different Workspace Lakehouse/Warehouse with both source and also destination. You can also use Notebooks to load data into different workspace.

Docs to refer -
Data Loading Options With Fabric Workspaces Part 1 of 2 – Yet Another Blog About The Medallion Archi...

Hope this is helpful. Please let me know incase of further queries.

[Anonymous]

Hello @cw88 

We haven’t heard from you on the last response and was just checking back to see if your query was answered.
Otherwise, will respond back with the more details and we will try to help.

[Anonymous]

Hi @cw88 ,

We haven’t heard from you on the last response and was just checking back to see if your query was answered.
Otherwise, will respond back with the more details and we will try to help.

[cw88]

Hi @Anonymous ,

i tried to copy my warehouse with deployment pipeline, but i got the same result as @arpost "Deployment couldn't be completed." 

Mayby there is there a general problem with the deployment of warehouses?

[arpost]

There definitely are some issues. I found while on a call with a MS support person yesterday that the DW did publish successfully some times but when relationships were added using the Model view in the DW, deployments failed with a generic message.