Forum Discussion

PriyaJha's avatar
PriyaJha
Icon for Helper I rankHelper I
2 years ago
Solved

Are ACID properties supported in Lakehouse

Hi All,   I am transferring some data from Azure SQL DB to Fabric Lakehouse table via Fabric data pipeline. I wanted to confirm if data pipeline fails for any reason in the middle of copy activity...
data pipeline
lakehouse
  • charlyS's avatar
    charlyS
    2 years ago

    Hello PriyaJha,

    As you can see here : https://learn.microsoft.com/en-us/fabric/data-science/tutorial-data-science-ingest-data 

     

    "Delta Lake - Delta Lake is an open-source storage layer that brings ACID transactions, scalable metadata management, and batch and streaming data processing to Apache Spark. A Delta Lake table is a data table format that extends Parquet data files with a file-based transaction log for ACID transactions and scalable metadata management."

     

    Delta Lake will provide some level of ACID support especially on your scenario, If you are looking for multi table acidity on a single transaction you will need to look at Data Warehouse insteak of Lakehouse. 

     

    But for your use case it's fully supported !

charlyS's avatar
charlyS
Icon for Most Valuable Professional rankMost Valuable Professional
2 years ago

Hello PriyaJha,

As you can see here : https://learn.microsoft.com/en-us/fabric/data-science/tutorial-data-science-ingest-data 

 

"Delta Lake - Delta Lake is an open-source storage layer that brings ACID transactions, scalable metadata management, and batch and streaming data processing to Apache Spark. A Delta Lake table is a data table format that extends Parquet data files with a file-based transaction log for ACID transactions and scalable metadata management."

 

Delta Lake will provide some level of ACID support especially on your scenario, If you are looking for multi table acidity on a single transaction you will need to look at Data Warehouse insteak of Lakehouse. 

 

But for your use case it's fully supported !