topic Fabric Lakehouse: What metadata gets synced to Git repository? in Data Engineering

Fabric Lakehouse: What metadata gets synced to Git repository?

kdoherty — Thu, 23 May 2024 15:12:59 GMT

I have a Fabric workspace synced to a repo in Azure Devops. The workspace contains a lakehouse with 3 tables. I expected to see metadata about the 3 tables in the devops repo, but the metadata file for my lakehouse is empty (see screenshot).

Is this to be expected? Is there documentation about exactly what information about the lakehouse gets synced to to git?

Thanks for any help.

Re: Fabric Lakehouse: What metadata gets synced to Git repository?

kdoherty — Thu, 23 May 2024 17:19:52 GMT

I found the documentation about git and lakehouses (see below). Git tracks the existence of the lakehouse, but not the objects within it, like tables and folders. LoL.

Why bother releasing stuff like this? Is it more important to Microsoft to "announce" there is lakehouse git integration than it is to provide something useful? I really want to love Fabric and excite people in my organization about what it can do. The reality of using the product is so frustrating sometimes.

https://learn.microsoft.com/en-us/fabric/data-engineering/lakehouse-git-deployment-pipelines

Re: Fabric Lakehouse: What metadata gets synced to Git repository?

Anonymous — Fri, 24 May 2024 09:14:08 GMT

Hi @kdoherty ,

Thanks for using Fabric Community.

As mentioned in the doc, right now only the Lakehouse container artifact is tracked in git in the current experience. Tables, folders, shortcuts and other metadata changes aren't tracked and versioned in git.

We are working on improving that and getting the definition of the lakehouse to be exported and deployed. It will come in pieces so it will take time until the full definition will become available.

I hope this helpful.

Re: Fabric Lakehouse: What metadata gets synced to Git repository?

kdoherty — Fri, 24 May 2024 10:28:06 GMT

Thank you @Anonymous. I will look forward to more complete support for Lakehouse in Git.

Re: Fabric Lakehouse: What metadata gets synced to Git repository?

Anonymous — Fri, 24 May 2024 10:32:30 GMT

Hi @kdoherty ,

Glad to know that your query got resolved. Please continue using Fabric Community on your further queries.

Re: Fabric Lakehouse: What metadata gets synced to Git repository?

Anonymous — Tue, 13 Aug 2024 03:09:18 GMT

Hi,

Are you confirming this will be supported at some stage? I couldn't see this in the documentation.

Re: Fabric Lakehouse: What metadata gets synced to Git repository?

Anonymous — Mon, 10 Feb 2025 20:36:54 GMT

Hi, I can see the document updated as;

Any updates on this as when we make any changes on a lakehouse in a workspace synced with git, are those tracked?