Warehouse data from prod to test

[cw88]

Hi,

does anyone have an idea how to get the data from warehouse from prod to test workspace? I need something like onprem "backup from prod database and restore on test server". 

Transferring the metadata (objects...) works with Source control, but for testing purposes in need the table data also.

[v-shex-msft]

HI @cw88,

You can create different Lakehouse/data warehouses in different workspaces, then you can use data pipeline/data flow simply copy and move data between these workspaces.

Copy Data from Lakehouse in Another Workspace Using Data pipeline | Microsoft Fabric Blog | Microsof...

How to copy data using copy activity - Microsoft Fabric | Microsoft Learn

Regards,

Xiaoxin Sheng

[cw88]

Hi @v-shex-msft ,

thanks for your reply. Do i have to do this for each single table or is there a function for all tables?

[v-shex-msft]

Hi @cw88,

In fact, one data flow/data pipeline can handle copy/move data of multiple tables. You not need to do create different processes for each tables.

Regards,

Xiaoxin Sheng

[R1k91 · Accepted solution]

I would use a lookup/script activity to get the list of table I need to copy and then in a foreach loop pass the name of the table ad "dynamic content" to copy activity source table nome property and table name destination.