Idea
A built-in Fabric feature where users can enable Data Quality Watch for any dataset, with automated monitoring β no code required.
π§ Key Capabilities
π Quality Rules β Auto & Custom
Missing values detection
Duplicate record checks
Data type & schema drift detection
Out-of-range / threshold alerts
Primary key & foreign key validity
Distribution shift detection
Nulls in key business fields (e.g., CustomerID, Amount)
Option to add custom rules using DAX or Power Query UI
π Data Quality Score
A model-wide 0β100 score calculated based on:
Completeness β
Accuracy β
Consistency β
Validity β
Timeliness / Freshness β
Display score trend over time
Highlight areas with most impact on score
Automated Insights
Copilot explains findings:
"Column email has 8% invalid values β common typo patterns detected like .con, missing @."
"Sales amount shows extreme values, likely data input error."
Real-Time Alerts
Email / Teams notification
Power BI alert integration
Fabric event triggers for pipeline correction
Example alert:
"Customer table completeness dropped to 94%. Null customer IDs detected in last batch."
Wizard Setup
User clicks: Enable Data Quality β Select Rules β Schedule β Save
No coding, just UI dropdowns:
Frequency: hourly / daily / per refresh / live
Sensitivity levels
Self-Learning Rules
System suggests rules based on historical data patterns:
"Phone number pattern inconsistent"
"New values seen in Country column β check validity"
Auto-Fix Recommendations
Not just alerts β intelligent suggestions:
| Missing product names | Fill using lookup table |
| Outlier sales values | Flag for review |
| Wrong date format | Standardize automatically |
Output
A Power BI-like dashboard showing:
Data quality score
Trend line
Failed rule summary
Affected tables & rows
Suggested fixes
Last check & next schedule
Benefits
| Manual data quality scripts | One-click automated quality checks |
| Hard to detect silent data issues | Alerts + score + trend |
| Late discovery of bad data | Freshness & schema drift monitoring |
| Tech-heavy validation | Low-code, business-friendly UI |
Future Enhancements
β ML-based anomaly detection at refresh
β Data quality benchmarking by industry template
β Export rules as YAML / JSON
β Integration with Fabric Data Pipeline error handling
β Score impact synced to Lineage View & Workspace Health
LinkedIn-Ready Caption
Building reliable analytics starts with clean data.
Fabric needs a Low-Code Data Quality Monitor that gives every dataset a Health Score, auto-detects errors, alerts users in real-time, and recommends fixes.
Data quality shouldn't require scripts β it should be as easy as turning on Power BI refresh.
Recent ideas
Allow External OneLake Data Shares to Be Accepted into Multiple Fabric Item Types
Fabric External Data Sharing provides an excellent zero-copy mechanism for sharing OneLake data across tenants. However, the receiving tenant currently has to accept the share into a Lakehouse. I w...Mourak16 hours agoNew MemberNew5Views0likes0CommentsAllow OneLake Shortcut Authentication Mode to Be Changed In Place
OneLake shortcuts support passthrough and delegated authentication, but changing the authentication model currently requires deleting and recreating the shortcut. I would like shortcut authenticatio...Mourak16 hours agoNew MemberNew7Views0likes0CommentsTenant-Wide OneLake Shortcut Lineage and Impact Analysis
This is grounded in a documented limitation: shortcut lineage is currently workspace-scoped, and Microsoft specifically says lineage for shortcuts to warehouses and semantic models isn't currently av...Mourak16 hours agoNew MemberNew15Views0likes1CommentAdd an End-to-End Production Reference Architecture for Microsoft Fabric Real-Time Intelligence
I would like to see a complete end-to-end Microsoft Fabric Real-Time Intelligence reference architecture that demonstrates how the individual RTI capabilities work together in a production-oriented s...Mourak16 hours agoNew MemberNew5Views0likes0CommentsImprove CI/CD consistency for Microsoft Fabric Real-Time Intelligence Eventstreams
Microsoft Fabric Real-Time Intelligence has made strong progress with Git integration and deployment pipelines, but lifecycle management can still be inconsistent across Eventstream sources, destinat...Mourak16 hours agoNew MemberNew3Views0likes0Comments