Forum Discussion

ObungiNiels's avatar
ObungiNiels
Resolver III
1 year ago
Solved

Deployment Process for Warehouse Projects

Hello fellow warehouse users,    I have a quite plain question: How are you realizing deployments processes of warehouses which are loaded with stored procedure definitions etc.?    In the past, ...
data warehouse
Warehouse
stuckerj's avatar
stuckerj
Helper I
7 months ago

Hi Srisakthi and others,

 

Thanks for the link to DacFx info.  I see this is a simple way to recreate the metadata in a new Warehouse. Any thoughts on taking it to the next step?

  1. Scripting the export and import, and especially:
  2. Getting the data from old to new Warehouse.

 

Thanks!

Jeff

Srisakthi's avatar
Srisakthi
Super User
7 months ago

Hi stuckerj ,

 

DacFx can be used only to deploy schemas. If we need to migrate data then we can do by the following way,

1. Data flow gen2

2. Data pipeline copy activity

3. Cross database queries

 

I have tried copying the parquet files from exisitng warehouse to new warehouse using one lake explorer but it is not working as expected.

Thanks,

Srisakthi

  • stuckerj's avatar
    stuckerj
    Helper I
    7 months ago

    Thanks!  This for simple backup and restore capabilities of the entire warehouse including multiple schemas--both for deployment pipeline and disaster recovery purposes.

     

    I'm considering creating a Notebook with script to loop through the tables and copy the data. 

     

    Any other options you'd recommend to consider?

    • Srisakthi's avatar
      Srisakthi
      Super User
      7 months ago

      Hi stuckerj ,

      If you have schema deployed at target warehouse then you can try using and it works when both warehouses are in same workspace 

      INSERT INTO targetwarehouse.[dbo].[table]
      SELECT * FROM sourcewarehouse.[dbo].[table];
       
      Regards,
      Srisakthi