Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
1 year ago
Solved

How to check data errors in the report as compared to the source

I have a power BI report hosted in wordpress. It comprises data from World Bank/commodity prices I collect data from the World Bank, Store it in my on-premise database, create a datamart in power ...
  • Anonymous's avatar
    Anonymous
    1 year ago

    Hi Anonymous 
    Thank you for reacging out to Microsoft fabric community.

    I recognize that manually verifying report data against your source each week can be both time-consuming and susceptible to errors. There is, however, an efficient solution to automate this process within Power BI. Below is a straightforward and reliable method you can use:

    Steps to Implement Automated Mismatch Detection:
    Store the Source Snapshot Separately:
    Each week, save the raw World Bank data (prior to transformations) in a dedicated table or flat file. This serves as your reference source for validation.

    Load Raw and Report Data into Power BI:
    In your Power BI model or a separate validation report, load both the raw source snapshot and the transformed data from your Power BI Datamart.
    Import data into Power BI Desktop

    Compare Datasets in Power Query:

    Use a Full Outer Join or Anti Join via Merge Queries in Power Query to compare the raw and report tables.

    Add indicators to flag missing or mismatched records, such as discrepancies in commodity prices or missing dates.
    Merge queries in Power Query

    Create a Validation Report Page:

    Display mismatches using a table visual.

    Include card visuals to show the number of mismatches.

    Apply conditional formatting to highlight discrepancies.
    Conditional formatting in Power BI

    Set Up Alerts :

    Publish the mismatch checker report to Power BI Service.

    Configure Power BI Alerts or Power Automate flows to receive notifications when mismatches occur (e.g., when the count is greater than zero).
    Data alerts in Power BI
    Trigger flows in Power Automate with Power BI

     

    This automated approach allows you to receive notifications of any mismatches, eliminating the need for manual checks and ensuring your report remains consistent with the source data.


    Regards,
    Sreeteja