Forum Discussion
From On-Premises SQL Server to Microsoft Fabric with a Metadata-Driven Medallion Pipeline
In this demo, I use DataCoolie to move WideWorldImporters data from an on-premises SQL Server into Microsoft Fabric. The pipeline is driven by one metadata.json file and follows the Bronze, Silver, a...
If you want to take it a step further and reach self correcting / self-healing stage take a look at this article
https://medium.com/@rishabh.gulati_94109/ms-fabric-building-self-healing-data-ecosystems-67a7e83c5380
I think my current development direction aligns with this article. The areas I'm still lacking are data quality and AI self-healing. Other than that, I've already covered the AI Agent development part using skills to guide metadata setup. You can take a look at the video to evaluate: Build a Medallion Data Pipeline with DataCoolie + AI | AWS, Fabric & Databricks