Forum Discussion
DirectLAke over OneLake how to use incremental load?
Hi jaryszek ,
Thank you for reaching out to the Microsoft Community Forum.
Hi anilelmastasi , Thank you for your prompt response.
Hi jaryszek ,
What Is the Correct Refresh Order?1. Raw Bronze --> append new files only
2. Silver --> upsert changes (MERGE)
3. Gold --> aggregations, denormalizationHow Consistency Is Maintained in Delta?
Delta Lake ensures:
1. ACID Transactions: Every write creates, _delta_log/NNNN.json, snapshot, commit metadata and optional checkpoint.
2. Snapshot Isolation: Readers always see the latest completed version.
3. No Locking Problems: Writers do not block readers.
I hope this information helps. Please do let us know if you have any further queries.
Regards,
Dinesh
Thanks,
how this is maitaining consistency?
What is the order of refreshing delta tables?
Best,
Jacek
Hi jaryszek ,
Thank you for reaching out to the Microsoft Community Forum.
Hi anilelmastasi , Thank you for your prompt response.
Hi jaryszek ,
What Is the Correct Refresh Order?
1. Raw Bronze --> append new files only
2. Silver --> upsert changes (MERGE)
3. Gold --> aggregations, denormalization
How Consistency Is Maintained in Delta?
Delta Lake ensures:
1. ACID Transactions: Every write creates, _delta_log/NNNN.json, snapshot, commit metadata and optional checkpoint.
2. Snapshot Isolation: Readers always see the latest completed version.
3. No Locking Problems: Writers do not block readers.
I hope this information helps. Please do let us know if you have any further queries.
Regards,
Dinesh
Hi jaryszek ,
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. And, if you have any further query do let us know.
Regards,
Dinesh