Forum Discussion
How to check data errors in the report as compared to the source
- Anonymous1 year ago
Hi Anonymous
Thank you for reacging out to Microsoft fabric community.
I recognize that manually verifying report data against your source each week can be both time-consuming and susceptible to errors. There is, however, an efficient solution to automate this process within Power BI. Below is a straightforward and reliable method you can use:Steps to Implement Automated Mismatch Detection:
Store the Source Snapshot Separately:
Each week, save the raw World Bank data (prior to transformations) in a dedicated table or flat file. This serves as your reference source for validation.
Load Raw and Report Data into Power BI:
In your Power BI model or a separate validation report, load both the raw source snapshot and the transformed data from your Power BI Datamart.
Import data into Power BI Desktop
Compare Datasets in Power Query:Use a Full Outer Join or Anti Join via Merge Queries in Power Query to compare the raw and report tables.
Add indicators to flag missing or mismatched records, such as discrepancies in commodity prices or missing dates.
Merge queries in Power QueryCreate a Validation Report Page:
Display mismatches using a table visual.
Include card visuals to show the number of mismatches.
Apply conditional formatting to highlight discrepancies.
Conditional formatting in Power BI
Set Up Alerts :Publish the mismatch checker report to Power BI Service.
Configure Power BI Alerts or Power Automate flows to receive notifications when mismatches occur (e.g., when the count is greater than zero).
Data alerts in Power BI
Trigger flows in Power Automate with Power BIThis automated approach allows you to receive notifications of any mismatches, eliminating the need for manual checks and ensuring your report remains consistent with the source data.
Regards,
Sreeteja
If your data source is something that still needs to be transformed, sliced and diced then how can you make an apple to apple comparison between your source and report? Unless the source itself produces its own set of reports...