topic Re: Is it possible yet to leverage delta log of a mirrored fabric database? in Data Engineering

Is it possible yet to leverage delta log of a mirrored fabric database?

dbWizard — Tue, 03 Jun 2025 20:57:56 GMT

We are calling our fabric mirrored database our raw layer... we would love the ability to somehow tap into the underlying delta log but that does not seem to be completely supported yet. Have tried hitting the abfss path directly referencing the delta log to no success. The goal here is to efficiently and incrementally load our data into advanced tiers of our mediallian archetecture. It's very simple to do a wack and load but lordy does that burn up the CUs.

Anyone had any success with this? I'm sure I could go the hashkey route but... wow.. whats the point of mirroring if I have to build all of that out? Using notebooks as the main driver for this.

Re: Is it possible yet to leverage delta log of a mirrored fabric database?

v-lgarikapat — Wed, 04 Jun 2025 07:48:40 GMT

Hi dbWizard ,

Thanks for reaching out to the Microsoft fabric community forum.
You're absolutely right to want to leverage the delta log from your Fabric mirrored database to drive efficient incremental loads especially if you're treating the mirrored database as your raw layer in a medallion architecture. Unfortunately, as of now , accessing the delta log of a Fabric mirrored database directly is not yet fully supported.

Explore Data in Your Mirrored Database Directly in OneLake - Microsoft Fabric | Microsoft Learn

Mirroring in Microsoft Fabric explained: benefits, use cases, and pricing demystified | Microsoft Fabric Blog | Microsoft Fabric

I would recommend submitting this scenario as a feature request in the official Power BI Ideas forum.

The Product Team actively reviews suggestions there, and if others in the community upvote it, it may be considered for future updates.

https://ideas.fabric.microsoft.com/

I trust this information proves useful. If it does, kindly “Accept as solution” and give it a 'Kudos' to help others locate it easily.
Thank you.

Re: Is it possible yet to leverage delta log of a mirrored fabric database?

dbWizard — Wed, 04 Jun 2025 16:44:54 GMT

Vote it up! https://community.fabric.microsoft.com/t5/Fabric-Ideas/Allow-Delta-Log-Access-for-Mirrored-Databases/idi-p/4720084#M161467

Re: Is it possible yet to leverage delta log of a mirrored fabric database?

Markpm_msft — Tue, 10 Jun 2025 13:59:14 GMT

v-lgarikapat
I've put the solution up on ideas. Ultra Epic Idea: Allow Direct Delta Log & Parquet ... - Microsoft Fabric Community

The user can access the delta logs. And can use time travel in over the delta tables to work out the difference.

Change Delta feed support is coming (Q3) as per roadmap.

Re: Is it possible yet to leverage delta log of a mirrored fabric database?

dbWizard — Tue, 10 Jun 2025 14:05:06 GMT

Thank you.