Forum Discussion
Understand the incremental refresh partitions
Can you please clarify this part ? :
Note: specifying 31 days will result in a maximum of 61 day partitions. You may not want that. Instead, use 1 Month.
When you say "31" days but you are in the last days of August (say, August 30) then "31 days" will also include July 31, which will automatically include ALL days in July - hence 61 partitions. Day partitions are only aggregrated into monthly partitions once they are no longer part of the refresh window.
Switching from "31 days" to "1 month" will reduce the number of partitions from 61 to 2 (ignoring the cold partitions for now)
How many rows are in each of the daily partitions?
I have data coming each 2nd business day for each month with the transaction date having the same value (as the 2nd business day) about 1000000 rows.
So what do you think ?