How much data can I expect to handle in PBI desktop

[DennisSchlein]

Hi 

I'm new to PBI. Im working on a model that on transaction level compares cost and sales.

It could be YTD sales ex. 30 million rows - and one month of cost ex. 3.500.000 rows.

Then I create a table with 2 common values, and then I compares amounts on both sides.

I do this on a lenovo t14 10g I7 with 32 gb of ram.

But it never finishes? is ti too much, or what could be the issue.

Inpurt is csv files, formatted to correct type right after input.

Any thought? Or where to find out what is causing my issues?

[123abc]

Power BI Desktop is a powerful tool for data analysis and visualization, but its performance can be affected by various factors, including the volume of data you're working with and the hardware specifications of your computer. Let's break down some of the factors that might be causing your issues:

1. Data Volume: Handling 30 million rows for YTD sales and 3.5 million rows for one month of cost is quite substantial, but Power BI should be able to handle it. However, performance can vary depending on the complexity of your data model and the operations you're performing.

2. Hardware: Your Lenovo T14 with an Intel Core i7 processor and 32GB of RAM is a decent machine for Power BI. However, if your data model and queries are very complex, you might still run into performance issues. Make sure you're not running other memory-intensive applications simultaneously.

3. Data Model: The efficiency of your data model design can significantly impact performance. Ensure that you have optimized relationships, calculated columns, and measures. Avoid using too many calculated columns as they can slow down performance.

4. Query Optimization: Optimize your data import queries. If you're merging tables or applying complex transformations, these operations can be resource-intensive. Use Power Query Editor to review and optimize your query steps.

5. Visualizations: Complex visuals with many data points can also slow down performance. Try to limit the number of visuals on your report page and avoid overloading them with data.

6. Data Types and Formatting: It's good that you're formatting your CSV files correctly upon import. Make sure that you're using appropriate data types for your columns to improve performance.

7. Indexing: Ensure that your data sources have proper indexing, especially if you are frequently filtering or sorting large datasets.

8. Performance Analyzer: Use Power BI's built-in Performance Analyzer to identify bottlenecks in your report. It can help you pinpoint which visuals or queries are causing the slowdown.

9. Data Refresh: If you're working with large datasets, consider configuring incremental data refresh to load only the new or changed data. This can significantly improve refresh times.

10. Check for Errors: Check the Query Diagnostics and Error messages to see if there are any specific issues reported that might be causing the long processing times.

If you've addressed these factors and are still experiencing performance issues, you might want to consider splitting your data into smaller chunks or aggregating it before loading into Power BI, depending on your specific analysis requirements.

Remember that performance optimization often involves a combination of factors, and it's a matter of fine-tuning your report and data model to achieve the best performance for your specific use case.