Forum Discussion

ati_puri's avatar
ati_puri
Resolver III
11 months ago
Solved

Handling version controlled Metadata files in Fabric

Hi,

 

Currently, in our project we are handling configuration files for the metadata-driven pipelines/notebooks in the file section of fabric lakehouse, however when we sync our lakehosue with GIT, only lakehouse metadata goes into GIT and not datafiles. This leads to an issue when we want to have those config files in our other environments like Test, Prod via GIT.

 

One solution is to have those metadata files in GIT as .josn files, is there any other solution which is currently being implemented as a version controlled metadata files inside or outside fabric.

  • We use metadata driven configuration json files and we save them in git.  To deploy the files to lakehouse we use fabric cli library as part of our CI CD process.