Roadmap for Git Integration of built-in resources for notebooks/environments

[ObungiNiels]

Hi all, 

we are currently dealing with a difficult scenario in a project where developed extensive transformation function and classes for outr ETL process inside Fabric. We are running a Lakehouse-centric archtecture, transforming data with notebooks through a medallion pattern. 

Since the functions are very lengthy, we consolidated them in a separated notebook which we are running using a magic command. However, running notebooks like that has proven to be a performance and monitoring burden due to the large size of the transformations we are importing. 

The solution seemed clear: Using the python built-in resources for notebooks and environments. With these, it is possible to store .py files with the classes and transformations inside which in turn can be imported to the notebook using a simple import command. 

The problem: these built-in resources are not git-integrated, making it almost impossible to enable all users across the organization to use the same and most recent version of the .py files. 

My question: I cannot find anything on the roadmap for enabling git integration of the built-in resources. Does anyone of you know anything specific on when we can count on further development in this context? 

Thank you! Have a good one. 

Kidn regards,

Niels 

[v-pnaroju-msft]

Hi fabDre,

Thankyou for the followup.

Based on my understanding, built-in notebooks and environment resources are not currently included in Fabric’s Git integration. At present, Git integration in Fabric applies only to supported workspace items such as notebooks, pipelines and other artifacts, as described here:
Overview of Fabric Git integration - Microsoft Fabric | Microsoft Learn
Notebook source control and deployment - Microsoft Fabric | Microsoft Learn

For roadmap visibility and prioritisation, we kindly request that you submit this feature request on the Fabric Ideas portal, which is actively monitored by the product team using the link:Fabric Ideas - Microsoft Fabric Community

For official updates, please monitor the “What’s new in Fabric” page using the link:What's New? - Microsoft Fabric | Microsoft Learn

We hope this information helps. If you have any further queries, please feel free to reach out to the Microsoft Fabric community.

Thank you.

[v-pnaroju-msft · Accepted solution]

Hi @ObungiNiels,

We sincerely appreciate your inquiry on the Microsoft Fabric Community Forum.

As per my understanding, Microsoft Fabric currently does not support Git integration for built-in resources such as .py files stored within notebooks and environments. This limitation presents challenges in synchronising and version-controlling these resources across the organisation. While there is no publicly available roadmap specifying when this feature will be implemented, the Microsoft Fabric team is actively working towards enhancing Git integration capabilities.

We kindly request you to stay updated with the latest developments and announcements by referring to the official Microsoft documentation through the link provided below:

What's New? - Microsoft Fabric | Microsoft Learn
Although the current lack of Git integration for built-in resources poses a challenge, leveraging the existing Git integration features for notebooks and environments can help mitigate some of these issues.

For further details, kindly refer to the following links:
Notebook source control and deployment - Microsoft Fabric | Microsoft Learn
Overview of Fabric Git integration - Microsoft Fabric | Microsoft Learn

If you find our response helpful, we would appreciate it if you could mark it as the accepted solution and provide kudos. This will assist other community members who may have similar queries.

Thank you.

[fabDre]

I wanted to follow up on this thread as we're facing the exact same challenge in our data engineering workflows. It's been several months since the initial response, and I'm wondering if there have been any updates or progress on Git integration for built-in resources in notebooks and environments?