Is it possible yet to leverage delta log of a mirrored fabric database?

[dbWizard]

We are calling our fabric mirrored database our raw layer... we would love the ability to somehow tap into the underlying delta log but that does not seem to be completely supported yet. Have tried hitting the abfss path directly referencing the delta log to no success. The goal here is to efficiently and incrementally load our data into advanced tiers of our mediallian archetecture. It's very simple to do a wack and load but lordy does that burn up the CUs. 

Anyone had any success with this? I'm sure I could go the hashkey route but... wow.. whats the point of mirroring if I have to build all of that out? Using notebooks as the main driver for this.

[dbWizard · Accepted solution]

Vote it up! https://community.fabric.microsoft.com/t5/Fabric-Ideas/Allow-Delta-Log-Access-for-Mirrored-Databases...

[Markpm_msft · Accepted solution]

@v-lgarikapat  
I've put the solution up on ideas.  Ultra Epic Idea: Allow Direct Delta Log & Parquet ... - Microsoft Fabric Community

The user can access the delta logs.   And can use time travel in over the delta tables to work out the difference. 

Change Delta feed support is coming (Q3) as per roadmap. 

[dbWizard]

Thank you. 

[v-lgarikapat]

Hi @dbWizard ,

Thanks for reaching out to the Microsoft fabric community forum.
You're absolutely right to want to leverage the delta log  from your Fabric mirrored database to drive efficient incremental loads especially if you're treating the mirrored database as your raw layer in a medallion architecture. Unfortunately, as of now , accessing the delta log of a Fabric mirrored database directly is not yet fully supported.

Explore Data in Your Mirrored Database Directly in OneLake - Microsoft Fabric | Microsoft Learn

Mirroring in Microsoft Fabric explained: benefits, use cases, and pricing demystified | Microsoft Fa...

I would recommend submitting this scenario as a feature request in the official Power BI Ideas forum.

The Product Team actively reviews suggestions there, and if others in the community upvote it, it may be considered for future updates.

https://ideas.fabric.microsoft.com/

I trust this information proves useful. If it does, kindly “Accept as solution” and give it a 'Kudos' to help others locate it easily.
Thank you.

[dbWizard · Accepted solution]

Vote it up! https://community.fabric.microsoft.com/t5/Fabric-Ideas/Allow-Delta-Log-Access-for-Mirrored-Databases...