Forum Discussion

Dayna's avatar
Dayna
Helper V
4 years ago

Incremental refresh causing duplicate rows

Hello,   I've implemented incremental refreshes on one of our fact tables, called 'Transactions'.   I can see on a given day there's been a change to some rows, and when this dataflow is consumed...
Need Help
lbendlin's avatar
lbendlin
Super User
4 years ago

Can you confirm that your M query is shaped according to the rules I mentioned?

Dayna's avatar
Dayna
Helper V
4 years ago

I've not configured this other than in the UI within the PowerBI service, it has automatically created this:

Table.SelectRows(#"Changed column type 2", each DateTime.From([pro2created]) >= RangeStart and DateTime.From([pro2created]) < RangeEnd)
  • lbendlin's avatar
    lbendlin
    Super User
    4 years ago

    That looks accurate. How do you know that records are duplicated?

    • Dayna's avatar
      Dayna
      Helper V
      4 years ago

      When I load in this dataflow into a report, my numbers for a specific day are inflated. When digging deeper, I can see multiple records for the same ID, which should be impossible as it's unique. 

       

      When I consume the dataflow in a new report, it's duplicated when filtering on one of these ID codes. Doing the same in the service though only brings back one result, which is strange... 

      • hmorrow's avatar
        hmorrow
        Frequent Visitor
        4 years ago

        Did you get a resolution on this? I'm having the same issue when setting incremental refresh on Power BI Online premium workspace. Any insight you can share would be helpful. Thank you.