Forum Discussion

FrankByl's avatar
FrankByl
New Member
3 months ago
Solved

How to stop PowerBI from automatically removing duplicates.

In our data we have some seemingly duplicate values that are not duplicate.  They just happen to be identical entries that appear twice on the same day.  PowerBI is removing those duplicates when we ...
Need Help
  • FrankByl's avatar
    FrankByl
    2 months ago

    Thank you everyone for your support.  Our eventual fix was to also export the time stamp on each entry.  Since some entries were identical in everyway they would always have a unique time stamp since they would be entered separately, if only one minute apart.  Once we included the time stamp this was sufficient data to identify unique records and we were able to export ALL records.

     

V-yubandi-msft's avatar
V-yubandi-msft
Icon for Community Support rankCommunity Support
2 months ago

Hi FrankByl ,

If you get a chance, please review the responses shared by danextian . They have correctly pointed out the key points, so kindly check and let us know if you need any additional details.

 

Thank you all for your valuable support danextian .

 

Regards,

Yugandhar.

FrankByl's avatar
FrankByl
New Member
2 months ago

I've reached out again since I don't know how to apply what he is suggesting.  "Make sure UniqueID is a calculated column or a Power Query column, then drag it onto the table visual itself and set it to Don't summarize (right-click the field in the visual). "  I've asked the software provider to add a Time stamp to the journal entries so that they will be unique.  Hope that helps

  • V-yubandi-msft's avatar
    V-yubandi-msft
    Icon for Community Support rankCommunity Support
    2 months ago

    Hi FrankByl ,

    Thanks for the update. From the community suggestions, it seems the next step is to check if the UniqueID column is included in the visual or PivotTable being exported, since this could impact how duplicate rows are handled.

     

    Could you review the recommendations and let us know what you find. If you can, sharing a screenshot of the visual/PivotTable setup and the export option used would help the community give more specific advice.

    Thank you everyone for your input.