How to check data errors in the report as compared to the source

[deepanwita25]

I have a power BI report hosted in wordpress. It comprises data from World Bank/commodity prices

I collect data from the World Bank, Store it in my on-premise database, create a datamart in power bi service and use the datamart in my power bi report.

I have to check the data manually everyweek to see if there are no data errors between what i am showing and what is in the source.
The manual check is error-prone at times where I fail to detect errors.
Is there a way to have a signal when there is mismatch of data between source and report??
Is anybody in the forum doing something similar and can help me?
Please let me know a way or tell me if you need more information on this!

[v-sshirivolu]

Hi @deepanwita25 
Thank you for reacging out to Microsoft fabric community.

I recognize that manually verifying report data against your source each week can be both time-consuming and susceptible to errors. There is, however, an efficient solution to automate this process within Power BI. Below is a straightforward and reliable method you can use:

Steps to Implement Automated Mismatch Detection:
Store the Source Snapshot Separately:
Each week, save the raw World Bank data (prior to transformations) in a dedicated table or flat file. This serves as your reference source for validation.

Load Raw and Report Data into Power BI:
In your Power BI model or a separate validation report, load both the raw source snapshot and the transformed data from your Power BI Datamart.
Import data into Power BI Desktop

Compare Datasets in Power Query:

Use a Full Outer Join or Anti Join via Merge Queries in Power Query to compare the raw and report tables.

Add indicators to flag missing or mismatched records, such as discrepancies in commodity prices or missing dates.
Merge queries in Power Query

Create a Validation Report Page:

Display mismatches using a table visual.

Include card visuals to show the number of mismatches.

Apply conditional formatting to highlight discrepancies.
Conditional formatting in Power BI

Set Up Alerts :

Publish the mismatch checker report to Power BI Service.

Configure Power BI Alerts or Power Automate flows to receive notifications when mismatches occur (e.g., when the count is greater than zero).
Data alerts in Power BI
Trigger flows in Power Automate with Power BI

This automated approach allows you to receive notifications of any mismatches, eliminating the need for manual checks and ensuring your report remains consistent with the source data.

Regards,
Sreeteja

[v-sshirivolu]

Hi @deepanwita25 ,

I hope the information provided above assists you in resolving the issue. If you have any additional questions or concerns, please do not hesitate to contact us. We are here to support you and will be happy to help with any further assistance you may need.

[v-sshirivolu]

Hi @deepanwita25 ,

I hope the above details help you fix the issue. If you still have any questions or need more help, feel free to reach out. We’re always here to support you

[danextian]

If your data source is something that still needs to be transformed, sliced and diced then how can you make an apple to apple comparison between your source and report? Unless the source itself produces its own set of reports...