Incremental refresh and partitions, how much is too much?

[Guillaume_]

there are many benefits of partitioning the data. Is there any limit or constraint to consider?

i.e. does it make sense to parition 5 years of data by day? would vertipaq scale and parallerize the queies as efficiently as parititioning by week or by month?

[Guillaume_]

so are we saying the number of partition does not matter? I cannot find any benchmark anywhere.

[GilbertQ]

Yes that is correct.

[GilbertQ]

Hi @Guillaume_ 

The biggest reason to use Incremental refreshing is so that you do not need to take hours to refresh your data. Other than that there is not a big performance improvement with incremental refreshing.

[Guillaume_]

so if I have a dataset hosting 7 years of daily records we're saying having 2555 partitions (7x365) per day may be more efficient to refresh than 84 partitions by period (12x7)?