Forum Discussion
AmiraBedh
Super User
2 years agoUnderstand the incremental refresh partitions
I have a table where I configured fact_transactions (the source is a SQL Server table) the incremental refresh like below : The fact_transactions contains data of a monthly basis trasact...
lbendlin
Super User
2 years agoWhen you say "31" days but you are in the last days of August (say, August 30) then "31 days" will also include July 31, which will automatically include ALL days in July - hence 61 partitions. Day partitions are only aggregrated into monthly partitions once they are no longer part of the refresh window.
Switching from "31 days" to "1 month" will reduce the number of partitions from 61 to 2 (ignoring the cold partitions for now)
How many rows are in each of the daily partitions?
AmiraBedh
Super User
2 years agoI have data coming each 2nd business day for each month with the transaction date having the same value (as the 2nd business day) about 1000000 rows.
So what do you think ?
- lbendlin2 years ago
Super User
As long as the monthly partitions refresh in well under 5 hours that is ok.