Forum Discussion

FilipK's avatar
FilipK
Resolver I
5 years ago
Solved

Duplicate value error while refresh without having a duplicate

I receive constantly an error during refresh on PBI Embedded (Gen 1) instance. Error message is: Column 'w_epochtime' in Table 'Data' contains a duplicate value '<pii>0-000-000\0050:1609455620276</...
Need Help
  • FilipK's avatar
    FilipK
    5 years ago

    Thanks to your ideas v-kkf-msft! I found out that incremental refresh I need to further look into i and I indeed I was succesful. My filter in DAX was not set correctly.

    = Table.SelectRows(dbo_View_..., each [msgtimelocal] >= RangeStart and [msgtimelocal] <= RangeEnd)

     

    Once I've changed it to 

     [msgtimelocal] > RangeStart and [msgtimelocal] <= RangeEnd

     

    everything works fine.

FilipK's avatar
FilipK
Resolver I
5 years ago

Thanks to your ideas v-kkf-msft! I found out that incremental refresh I need to further look into i and I indeed I was succesful. My filter in DAX was not set correctly.

= Table.SelectRows(dbo_View_..., each [msgtimelocal] >= RangeStart and [msgtimelocal] <= RangeEnd)

 

Once I've changed it to 

 [msgtimelocal] > RangeStart and [msgtimelocal] <= RangeEnd

 

everything works fine.

Standef's avatar
Standef
Helper I
3 years ago

Thanks FilipK  Had the same problem and you solved it.

In the Native Query I was using "Between" instead of >= and <.
As the incremental refresh was not sending 1 query for all the historical data but several small queries of partitions and putting them back together, the between statement in SQL is including both days (start and end) and that's the reason I had an overlap and a double counting.