Forum Discussion
Maintenance on Lakehouse Tables
Hi rtolsma ,
I believe the issue is that the Dataverse data is not actually managed by Fabric, tables are pointers to your dataverse environment, the error while annoying is correct.
5 ways to get your Dataverse Data into Microsoft Fabric / OneLake - DEV Community
This blog describes different ways of syncing Dataverse data into Fabric.
Just to be sure, which option in the blog article (link above) are you using?
There are two main options (besides traditional ETL using dataflows, pipelines or notebooks):
- Link to Fabric
- Azure Synapse Link (this is also an option for syncing Dataverse data for consumption in Fabric)
Could you confirm which option you are using?
Anyway, I'm surprised that you're seeing OneLake storage being consumed, although I don't have extensive personal experience with the Link to Fabric or Azure Synapse Link options. Can you confirm that you don't have set up any notebooks/dataflows/pipelines which copies some data physically in OneLake?
I notice that your data storage in OneLake was first empty, and then there was some data from October 15, before it started increasing rapidly from October 24th. Is October 24th the day when you activated the link? Or did some other process starting to generate data on this date, some process which physically stores data in OneLake, in the workspace called Fabric?
Ref. your screenshot which shows that the OneLake data is stored in a workspace called Fabric. Is this the name of the workspace which contains the Dataverse Lakehouse? Or is this another workspace?
There is also a yammer forum for the Dataverse Link functionality, it covers both the Link to Fabric and Azure Synapse Link option. I think this is the link: Viva Engage : Dynamics 365 and Power Platform Preview Programs (although I cannot confirm 100% that this is the real link to that forum, but I think it is).
Thanks for the references! I'll do some more digging into the actual data, but yes, the inventrans table as an example is sitting at 3GB of delta lake files. I'm part of the D365 preview community groups on Yammer, so I may post my questions there and discuss with the Fabric Link product team.
Thanks for all your help as well!
I think the shortcuts can show with "xGB" (for example 3GB) in Fabric and the files can show in the "view files", but the data should actually be stored in Dataverse, if you are indeed using the Link to Fabric option.
But the shortcuts should not show as storage in the Fabric Capacity Metrics app (I think). Because the data should be stored in Dataverse, if using the Link to Fabric option.
Is there some other (non-shortcut) data in the workspace called Fabric? I.e. some data which is actually stored physically in that workspace.
I notice that your data storage in OneLake was first empty, and then there was some data from October 15, before it started increasing rapidly from October 24th. Is October 24th the day when you activated the link?
Or did some other process starting to generate data on October 24th, some process which physically stores data in OneLake, in the workspace called Fabric?
Best of luck in getting to the root of it! 😀
As mentioned by richbenmintz , OneLake File Explorer can perhaps provide some insights into this case.
Azure Storage Explorer is another option which provides a different view into the OneLake storage: Integrate OneLake with Azure Storage Explorer - Microsoft Fabric | Microsoft Learn