Duplicate Value

Question

Evething is okay until yesterday but I got an refresher error this morning. It said that FACT_ORDERS table contains a duplicate value, so I go to the database and write a simple query to check: there are no duplicate values showing.

I found the solution in PBI Community (use Remove Duplicates in Power Query) but I really want to know what caused this issue. Does anyone know?

Thanks!

otravers · Answer

Are you using incremental refresh on this table?

congda · Answer

Yes, I am. Does it make this error? Could you explain for me? Thank you

otravers · Answer

Check that you're using &lt; RangeEnd, not &lt;= in your filter.

congda · Answer

I'm using&nbsp;&lt; RangeEnd&nbsp;😭 I still don't know why this happened. Why is it related to RangEnd and incremental refresh?

otravers · Answer

Why improperly setting RangeStart/RangeEnd filters can lead to duplicates is documented here:https://docs.microsoft.com/en-us/power-bi/connect-data/incremental-refresh-configure#filter-data&nbsp;In your case it doesn't seem to be the root cause for your duplicates. If there are no duplicates in your source data then I'd doublecheck that I have nothing in my ETL (e.g. appending tables) that may cause these duplicates.

Forum Discussion

Duplicate Value

5 Replies

Related content

remove duplicate value within a row

Duplicate Value

Duplicate ranking

MAXX Returning duplicate values

Duplicate value error