Forum Discussion
Marico
Helper IV
1 year agoIncremental data load in Power BI file
Hi, I have a Power BI file with around 70-80M rows of data. The data is already summarized at the back-end and no further data compression at the database level can be done. I was wondering i...
- Anonymous1 year ago
Hi Marico ,
Yes, you can improve report performance even with datasets larger than 5 GB. Power BI offers several methods to help optimize speed and user experience. Here are some tips:
- Use Aggregations: Create summary tables to reduce data volume and improve load times. Power BI can switch between aggregated and detailed data as needed.
- Optimize the Data Model: Remove unused columns and tables, avoid high-cardinality columns, and use numeric keys for relationships.
- Use Hybrid or Composite Models: Store large fact tables in DirectQuery mode and import only smaller dimension tables to save memory.
- Apply Incremental Refresh: Use incremental refresh for large datasets with date/time fields to process only recent or changed data.
- Limit Visual and Filter Interactions: Reduce the number of slicers and filters, and use the "Apply" button for filters to control when visuals update.
- Split Reports: Divide complex reports into multiple pages or files so users only load what they need.
- Use Performance Analyzer: Identify slow visuals or queries with the Performance Analyzer and optimize them.
- Upgrade to Power BI Premium: Premium capacity provides more memory and processing power for large datasets.
Thank you again.
Idrissshatila
Super User
1 year agoHello Marico ,
yes, this i done through incremental refresh, check it out
https://youtu.be/Kui_1G6kQIQ?si=-nc4QnPQClB-GTRs