Forum Discussion
Dynamic averages and large data
Hi all,
I'm trying to resolve a problem with dynamic averages and a large set of data that will only keep growing. The current set is roughly 15 million records, takes maybe 20 min to refresh. I've got 2 slicers, with a variable amount of options in each. What i'm doing is calculating the average for values and it is adjusting according to what's selected in the slicers. Since we're talking about averages, and I want the slicers to have an affect on the data where it changes the average according to what's selected, I can't pre calculate the average before it gets to BI. Everything's working fine, i'm just concerned about the size and the refresh time (even though it's refreshed once a week). Is 15 million rows a lot for one table in BI? Is there a better way to accomplish what i'm doing?
Hi, feenixfire
Based on your description, 15 million rows are not a lot for one table in Power BI. It is reasonable that 15 million records take 20 minutes to refresh. Scheduled refresh for imported datasets timeout after two hours. This timeout is increased to five hours for datasets in Premium workspaces. If you encounter this limit, consider reducing the size or complexity of your dataset, or consider breaking the dataset into smaller pieces.
Best Regards
Allan
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
3 Replies
Hi, feenixfire
Based on your description, 15 million rows are not a lot for one table in Power BI. It is reasonable that 15 million records take 20 minutes to refresh. Scheduled refresh for imported datasets timeout after two hours. This timeout is increased to five hours for datasets in Premium workspaces. If you encounter this limit, consider reducing the size or complexity of your dataset, or consider breaking the dataset into smaller pieces.
Best Regards
Allan
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Please check if this can help
https://radacad.com/power-bi-aggregation-step-1-create-the-aggregated-table
Appreciate your Kudos. In case, this is the solution you are looking for, mark it as the Solution. In case it does not help, please provide additional information and mark me with @
Thanks. My Recent Blog -
https://community.powerbi.com/t5/Community-Blog/Winner-Topper-on-Map-How-to-Color-States-on-a-Map-with-Winners/ba-p/890814
https://community.powerbi.com/t5/Community-Blog/HR-Analytics-Active-Employee-Hire-and-Termination-trend/ba-p/882970
https://community.powerbi.com/t5/Community-Blog/Power-BI-Working-with-Non-Standard-Time-Periods/ba-p/881739
https://community.powerbi.com/t5/Community-Blog/Comparing-Data-Across-Date-Ranges/ba-p/823601I'll work through that page but I don't see how the averages will recalculate based on what the user selects in the slicer.
