Don't miss your chance to take exam DP-600 or DP-700 on us!
Request nowLearn from the best! Meet the four finalists headed to the FINALS of the Power BI Dataviz World Championships! Register now
My general inquiry is on how PowerBI handles/refreshes large data sets (1 million + rows).
Ex. You import MySQL query all historical and current data from a call center. For any new data that comes in, will Power BI refresh all of the data including the historical/current/new? or just refresh the new data?
Solved! Go to Solution.
Powerbi can easily handly 1 mill rows as it's a highly compressed column store data structure.
Load times will vary depending on the complexity of your data and the amount of differnt values. I recommend spitting date and times to reduce the different values and help the compression.
You can have 2 queries with current and history data and then merge the results. You can disable refresh on the history and update only when you change the boundary between current and history..
Direct query is also an option that only queries your data when you need it. I don't think MySql support direct query at the moment.
If you are using the power bi service and on premium then you can use incremental loading feature.
https://powerbi.microsoft.com/en-us/blog/incremental-refresh-in-power-bi-premium/
There is also aggregation data so you can have summaries rather than details for all your data and direct query can then get small data sets for details if needed.
Other Options are Azure Analysis services or on prem Cubes that can be loaded incrementally.
Powerbi can easily handly 1 mill rows as it's a highly compressed column store data structure.
Load times will vary depending on the complexity of your data and the amount of differnt values. I recommend spitting date and times to reduce the different values and help the compression.
You can have 2 queries with current and history data and then merge the results. You can disable refresh on the history and update only when you change the boundary between current and history..
Direct query is also an option that only queries your data when you need it. I don't think MySql support direct query at the moment.
If you are using the power bi service and on premium then you can use incremental loading feature.
https://powerbi.microsoft.com/en-us/blog/incremental-refresh-in-power-bi-premium/
There is also aggregation data so you can have summaries rather than details for all your data and direct query can then get small data sets for details if needed.
Other Options are Azure Analysis services or on prem Cubes that can be loaded incrementally.
Share feedback directly with Fabric product managers, participate in targeted research studies and influence the Fabric roadmap.
Check out the February 2026 Power BI update to learn about new features.
| User | Count |
|---|---|
| 51 | |
| 40 | |
| 37 | |
| 14 | |
| 14 |
| User | Count |
|---|---|
| 85 | |
| 69 | |
| 38 | |
| 29 | |
| 27 |