Incremental refresh duplicate

[sananthv]

After setting up date/time parameters named RangeStart and RangeEnd, when i apply custom filter the "last changed" date column as indicated in the documentation https://docs.microsoft.com/en-us/power-bi/service-premium-incremental-refresh , some records are getting duplicates. 

When I remove the the custom filter from the column I am not getting any duplicates or triplicates. I am connecting to Amazon RDS (Postgresql) from PBI desktop Version: 2.59.5135.601 64-bit (June 2018).

I can apply "remove duplicates" in the query editor, but it will not solve the problem. Has anyone enounctered anything like this?

[Smokey24]

Did you solve this? Or did you find the issue?

I have the same issue, that after incremental refresh I get a few duplicates.

Anyone got a suggestion?

Thanks!

[Anonymous]

This can happen if the date ranges are set NOT up to as follows: [Date] >= RangeStart and [Date] < RangeEnd. Is your upper bound set to be equal to or less than or just less than?

[Anonymous]

I have a similar problem. I'm connecting directly to an API through Web.Content function and, when applying the schedule refresh I get some duplicated values.

Has anyone found a way to solve this?

[v-juanli-msft]

Hi @sananthv

I can't reproduce your problem.

After setting up date/time parameters named RangeStart and RangeEnd, when i apply custom filter the "last changed" date column as indicated in the documentation, some records are getting duplicates.  

Records getting duplicates happens once you apply the custome filter instead of applying refresh, right?

How about applying this function in the Advanced editor?

Table.Distinct(table as table, optional equationCriteria as any)

Best Regards

Maggie