Forum Discussion
gehe_bbe
3 years agoFrequent Visitor
High Ram and CPU Consumption with small data
Hi Everybody, I'm struggling with modelling my Excel file together with Powerquery. I need two "final" tables, one ist SalesData (Sales) the other one ist Amount of Customers in a shop (People). ...
rubayatyasmin
3 years agoCommunity Champion
Hi, gehe_bbe
Here are some suggestions to address the performance and memory usage issues:
- Consolidate data sources into a single source if possible.
- Streamline and optimize Power Query steps for better performance.
- Implement incremental refresh for partial data updates.
- Ensure query folding is taking place where applicable.
- Split complex queries into smaller, more manageable ones.
- Monitor resource usage during data refresh.
- Consider using Power BI Desktop for larger datasets and complex calculations.
If my assistance helps you in any way, appreciate the kudos. 👍
- gehe_bbe3 years agoFrequent Visitor
Hi rubayatyasim,
thank for the suggestion, but keep in mind:
- No change of the steps between Concept 1 and Concept 2 (but change in RAM/CPU usage)
- Very small data, so there ist no need vor incremental refresh
- PowerBI Desktop is no option, it's an Excel-Tool.
Regards Steve
- rubayatyasmin3 years agoCommunity Champion
You can check for these options
- Optimize Power Query steps by removing redundancies and using efficient techniques.
- Manage query dependencies to minimize redundant calculations.
- Disable background data refresh in Power Query Options.
- Consider splitting queries or workbooks for complex scenarios.
- Monitor and optimize data types for improved performance.
- Ensure sufficient system resources and close unnecessary applications.
if my assistance helps you in any way, appreciate the kudos. If solves your problem, accept the solution as the answer.
Thanks