will_wainwright
1 year agoRegular Visitor
Lakehouse Data Quality Framework
Link to notebook: NB_Testing_Framework
This notebook lets you automate data quality tests for your Fabric Lakehouse.
Simply add your tests to a YAML config file, and this notebook will run them dynamically using Spark SQL.
Test results are saved to a Delta table, which you can use to build Power BI reports or set up data alerts.
The framework is lightweight and extendable; making it easy to add new test types or customize validations as your needs grow.
https%3A%2F%2Fgithub.com%2Fwillwainwright%2FFabricNotebooks%2Fblob%2Fmain%2FNB_Testing_Framework.ipynb
No RepliesBe the first to reply