Forum Discussion

alfBI's avatar
alfBI
Icon for Responsive Resident rankResponsive Resident
2 years ago
Solved

Lakehouse/Warehouse Backups ?

Hi,

 

It might looks a stupid question but after some time working with Fabric I have not yet a clear idea about how to handle data recovery in situations such as a mistake deleting a Fabric artifacts (e.g: a warehouse/lakehouse) or try to recover the content of a table on a lakehouse/warehouse that has been accidentally removed or deleted.

 

Using Azure SQL or SQL on premise these questions have an obvious answer because these tools have a plethora of backup mechanism to manage these scenarios. But, what happens in Fabric? 

 

Thx

 

Alfons

5 Replies

    • alfBI's avatar
      alfBI
      Icon for Responsive Resident rankResponsive Resident

      Hi v-gchenna-msft,

       

      I have been redafing the blog you mentioned aloingside and the official MS docs about Fabric disaster recovery. My conclusion after carefully reading both is that data recovery on Fabric data engineering (WH & LH)) mainly relies on delta table capabilities to restore a table at a specific point in time using time travel. 

      To take leverage of delta tables timeline capabilities for managing data recovery scenarios is not bad on its own, but (and this is my main concern) this approach misses other disaster recovery scenarios where  restoration is required at item level (whole warehouse/lakehouse, tables/views/ storeprocedures/notebooks).

       

      How to proceed if a table/view/store procedure has been completely removed from the WH? Or even worse , what about the whole WH/LH as has been "accidentally" dropped?

       

      In such a cases MS docs provides 2 options

       

      1) make use of "Disaster recovery capacity setting" to keep a copy of all Fabric items (which includes WH/LH) on a secondary region. OK, this may work, but sounds to me as using a sledgehammer to crack a nut. (Leaving aside the extra cost)

       

      2) Another suggestion option is keep WH code (table, view, stored procedure) versioned and saved in a safe location (such as Git). I certainly prefer this last one, but git is primarily a version control system rather than a traditional backup tool.

       

      In summary, imho MS provides workarounds on Fabric for managing disastery recovery scenarios but any of them might be fully considered as "actual" backup methods (at least as I understand them).

       

      I firmly belive that MS should consider for future Fabric releases some kind of pure-backup mechanism (not based on tables timeline or versioned git code)

       

      Regards,

       

      Alfons

       

      Thanks,

      • Anonymous's avatar
        Anonymous
        Not applicable

        Hi alfBI ,

        Glad to know that your query got resolved. Please continue using Fabric Community on your further queries.

  • Hey,

    Based on my understanding, Unfortunately as of today there is no backup aspect for fabric lakehouse
    Currently there is no backup support of lakehouses. The best you can do is manually replicate the data to another lakehouse. 

    Similar thread : https://community.fabric.microsoft.com/t5/General-Discussion/Lakehouse-Backup/td-p/3657787#:~:text=User%20replacing%20the%20data%20in,the%20data%20to%20another%20lakehouse.


    For fabirc warehouse,you can follow the lniks shared in another reply here and can make use of restore point

  • frithjof_v's avatar
    frithjof_v
    Icon for Community Champion rankCommunity Champion

    Can the Data Warehouse recovery actually restore a deleted warehouse?

     

    Or only recover old data (old snapshot) of an existing warehouse?

     

    It seems you need the warehouse GUID in order to recover data warehouse to an earlier version.

    https://blog.fabric.microsoft.com/nb-NO/blog/the-art-of-data-warehouse-recovery-within-microsoft-fabric/ 

     

    How to get the GUID if the data warehouse has already been deleted? 

    And will the recovery work if the data warehouse has already been deleted?