Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Find everything you need to get certified on Fabric—skills challenges, live sessions, exam prep, role guidance, and more. Get started

Reply
Guillaume_
Helper I
Helper I

Incremental refresh and partitions, how much is too much?

there are many benefits of partitioning the data. Is there any limit or constraint to consider?

i.e. does it make sense to parition 5 years of data by day? would vertipaq scale and parallerize the queies as efficiently as parititioning by week or by month?

4 REPLIES 4
Guillaume_
Helper I
Helper I

so are we saying the number of partition does not matter? I cannot find any benchmark anywhere.

Yes that is correct.





Did I answer your question? Mark my post as a solution!

Proud to be a Super User!







Power BI Blog

GilbertQ
Super User
Super User

Hi @Guillaume_ 

 

The biggest reason to use Incremental refreshing is so that you do not need to take hours to refresh your data. Other than that there is not a big performance improvement with incremental refreshing.





Did I answer your question? Mark my post as a solution!

Proud to be a Super User!







Power BI Blog

so if I have a dataset hosting 7 years of daily records we're saying having 2555 partitions (7x365) per day may be more efficient to refresh than 84 partitions by period (12x7)?

Helpful resources

Announcements
Fabcon_Europe_Social_Bogo

Europe’s largest Microsoft Fabric Community Conference

Join the community in Stockholm for expert Microsoft Fabric learning including a very exciting keynote from Arun Ulag, Corporate Vice President, Azure Data.

Power BI Carousel June 2024

Power BI Monthly Update - June 2024

Check out the June 2024 Power BI update to learn about new features.

PBI_Carousel_NL_June

Fabric Community Update - June 2024

Get the latest Fabric updates from Build 2024, key Skills Challenge voucher deadlines, top blogs, forum posts, and product ideas.

RTI Forums Carousel3

New forum boards available in Real-Time Intelligence.

Ask questions in Eventhouse and KQL, Eventstream, and Reflex.

Top Solution Authors