Forum Discussion
Incremental and Max Memory usage for a P1
I followed up on the incremental refresh issue by testing with half of the dataset, and it appears to work successfully. Although this solution is manageable, ideally, I would prefer to utilize the full dataset for our analyses.
It seems that the full data volume might be overwhelming the system, but if there are any additional insights or recommendations that could help us accommodate the entire dataset without compromising performance, I would greatly appreciate your advice.
I have already minimized the cardinality for our main table, which contains approximately 270 million rows and accounts for 95% of the dataset size. This table has been optimized with the fewest columns necessary and an efficient primary key setup.
Despite these optimizations, I'm still facing challenges with managing the full dataset during the incremental refresh process. If there are further optimization strategies or adjustments within Power BI that could help manage such a large dataset more effectively, I would be keen to learn about them.