Forum Discussion

Dayna's avatar
Dayna
Helper V
4 years ago

Incremental refresh causing duplicate rows

Hello,   I've implemented incremental refreshes on one of our fact tables, called 'Transactions'.   I can see on a given day there's been a change to some rows, and when this dataflow is consumed...
Need Help
Dayna's avatar
Dayna
Helper V
4 years ago

Hello,

I'm not seeing duplicates in the service though, only when consumed within the report. Is this expected behaviour for the incremental refresh?

Thanks,
Dayna

lbendlin's avatar
lbendlin
Super User
4 years ago

Can you confirm that your M query is shaped according to the rules I mentioned?

  • Dayna's avatar
    Dayna
    Helper V
    4 years ago

    I've not configured this other than in the UI within the PowerBI service, it has automatically created this:

    Table.SelectRows(#"Changed column type 2", each DateTime.From([pro2created]) >= RangeStart and DateTime.From([pro2created]) < RangeEnd)
    • lbendlin's avatar
      lbendlin
      Super User
      4 years ago

      That looks accurate. How do you know that records are duplicated?

      • Dayna's avatar
        Dayna
        Helper V
        4 years ago

        When I load in this dataflow into a report, my numbers for a specific day are inflated. When digging deeper, I can see multiple records for the same ID, which should be impossible as it's unique. 

         

        When I consume the dataflow in a new report, it's duplicated when filtering on one of these ID codes. Doing the same in the service though only brings back one result, which is strange...