Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Learn from the best! Meet the four finalists headed to the FINALS of the Power BI Dataviz World Championships! Register now

Reply
Anonymous
Not applicable

Inquiry Regarding PowerBI's ability to handle large data sets

My general inquiry is on how PowerBI handles/refreshes large data sets (1 million + rows). 

 

Ex. You import MySQL query all historical and current data from a call center. For any new data that comes in, will Power BI refresh all of the data including the historical/current/new? or just refresh the new data? 

1 ACCEPTED SOLUTION
stretcharm
Memorable Member
Memorable Member

Powerbi can easily handly 1 mill rows as it's a highly compressed column store data structure.

Load times will vary depending on the complexity of your data and the amount of differnt values. I recommend spitting date and times to reduce the different values and help the compression.

 

You can have 2 queries with current and history data and then merge the results. You can disable refresh on the history and update only when you change the boundary between current and history..

 

Direct query is also an option that only queries your data when you need it. I don't think MySql support direct query at the moment.

 

If you are using the power bi service and on premium then you can use incremental loading feature.

https://powerbi.microsoft.com/en-us/blog/incremental-refresh-in-power-bi-premium/

 

There is also aggregation data so you can have summaries rather than details for all your data and direct query can then get small data sets for details if needed.

https://powerbi.microsoft.com/en-us/blog/aggregations-for-petabyte-scale-bi-available-in-the-power-b...

 

Other Options are Azure Analysis services or on prem Cubes that can be loaded incrementally.

 

 

View solution in original post

1 REPLY 1
stretcharm
Memorable Member
Memorable Member

Powerbi can easily handly 1 mill rows as it's a highly compressed column store data structure.

Load times will vary depending on the complexity of your data and the amount of differnt values. I recommend spitting date and times to reduce the different values and help the compression.

 

You can have 2 queries with current and history data and then merge the results. You can disable refresh on the history and update only when you change the boundary between current and history..

 

Direct query is also an option that only queries your data when you need it. I don't think MySql support direct query at the moment.

 

If you are using the power bi service and on premium then you can use incremental loading feature.

https://powerbi.microsoft.com/en-us/blog/incremental-refresh-in-power-bi-premium/

 

There is also aggregation data so you can have summaries rather than details for all your data and direct query can then get small data sets for details if needed.

https://powerbi.microsoft.com/en-us/blog/aggregations-for-petabyte-scale-bi-available-in-the-power-b...

 

Other Options are Azure Analysis services or on prem Cubes that can be loaded incrementally.

 

 

Helpful resources

Announcements
Join our Fabric User Panel

Join our Fabric User Panel

Share feedback directly with Fabric product managers, participate in targeted research studies and influence the Fabric roadmap.

February Power BI Update Carousel

Power BI Monthly Update - February 2026

Check out the February 2026 Power BI update to learn about new features.

FabCon Atlanta 2026 carousel

FabCon Atlanta 2026

Join us at FabCon Atlanta, March 16-20, for the ultimate Fabric, Power BI, AI and SQL community-led event. Save $200 with code FABCOMM.