Incremental refresh is adding an extra day

[AxiomaticOne]

This make zero logical sense to me...what am I missing?

Here is what happened today 6/22:

• If the "only refresh complete days" box IS checked the following dates were refreshed:
  • 31, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21
  • 22 days complete days were refreshed.
  • Partitions in May were not consolidated.
• If the "only refresh complete days" box is not checked the following dates were refreshed:
  
  • 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22
  • 21 complete days and 1 partial day were refreshed.
  • Partitions in May WERE consolidated.
  • Interestingly enough they were NOT consolidated when this ran yesterday 6/21.

What this tells me is that even though I've only told Power BI to refresh the last 21 days it is appears to add an extra day to both the exclude today and include today selection.  Again that just doesn't make sense based on this but it is what it is. 

 

The times in the images are UTC time. My timezone is Central the premium capacity is in Central.

[Anonymous]

Hi @AxiomaticOne ,

Whether the advice given by @lbendlin   has solved your confusion, if the problem has been solved you can mark the reply for the standard answer to help the other members find it more quickly. If not, please point it out.

Best regards,
Albert He

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly

[lbendlin]

the premium capacity is in Central.

 Doesn't matter, the partition management is based on UTC.

[AxiomaticOne]

Respectfully this isn't a helpful comment and is distracting to anyone looking at this issue.  This dissuades people from providing information about their environment upfront if they are only going to be told what isn't relevant to the issue being presented. I hadn't said it was the sole issue.

[lbendlin]

Did you figure out what caused the extra day?

[AxiomaticOne]

Regretfully no, I have it on the backlog to go back and do detailed testing on smaller incremental refresh periods and create multiple tables with different settings.

As a work around we've just added +1 day to the expected range so that we can hit the partitions with an API refresh monthly to true up historical data.

[lbendlin]

Just to confirm - you made RangeStart inclusive and RangeEnd exclusive?

[AxiomaticOne]

Fair question. Yes that is true:

[lbendlin]

the parameter needs to be called RangeStart, not varRangeStart . And you seem to be missing the single quotes.

[AxiomaticOne]

It is:

[lbendlin]

If you like me to help you please show the entire code (minus the sensitive parts).