Microsoft Fabric Community Conference 2025, March 31 - April 2, Las Vegas, Nevada. Use code MSCUST for a $150 discount.
Register nowThe Power BI DataViz World Championships are on! With four chances to enter, you could win a spot in the LIVE Grand Finale in Las Vegas. Show off your skills.
Evething is okay until yesterday but I got an refresher error this morning. It said that FACT_ORDERS table contains a duplicate value, so I go to the database and write a simple query to check: there are no duplicate values showing.
I found the solution in PBI Community (use Remove Duplicates in Power Query) but I really want to know what caused this issue. Does anyone know?
Thanks!
Are you using incremental refresh on this table?
Yes, I am. Does it make this error? Could you explain for me? Thank you
Check that you're using < RangeEnd, not <= in your filter.
I'm using < RangeEnd 😭 I still don't know why this happened. Why is it related to RangEnd and incremental refresh?
Why improperly setting RangeStart/RangeEnd filters can lead to duplicates is documented here:
https://docs.microsoft.com/en-us/power-bi/connect-data/incremental-refresh-configure#filter-data
In your case it doesn't seem to be the root cause for your duplicates. If there are no duplicates in your source data then I'd doublecheck that I have nothing in my ETL (e.g. appending tables) that may cause these duplicates.
March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount!
If you love stickers, then you will definitely want to check out our Community Sticker Challenge!
User | Count |
---|---|
49 | |
28 | |
20 | |
20 | |
19 |
User | Count |
---|---|
52 | |
51 | |
26 | |
26 | |
22 |