Forum Discussion
Solved
Model with loading very big CSV files - best practices.
Hello, I have model where I am loading 50 GB + of data in flat tables (csv). I am using just Folder.Files to get data. But the issue is that it is too big for some matrix visuals and getting...
Hi jaryszek,
Pre aggregating older data means keeping full detailed records for the recent period (like the last one or two years) but storing only monthly or yearly totals for older years. This makes your model much smaller and faster because old data rarely needs transaction-level detail. In Power BI, you can do this by splitting your fact table into recent and old data in Power Query, summarizing the old data by year/month and key fields, and then combining it back with the recent detailed data.
Thanks & Regards,
Prasanna Kumar
Hi jaryszek,
Just following up to see if the Response provided was helpful in resolving your issue. Please feel free to let us know if you need any further assistance.
Best regards,
Prasanna Kumar