Forum Discussion
How does Schedule Refresh internal logic work in Power BI
wwhittenton : Thank You for detailed explaination. 🙂
Yes i have 50 tables ( 1 table in each .pbix) but there is no relationships between them. These table is shown as tabular visual. Unfortunately, there are too many columns that i have to show inside table visual though there is no redundant data.
User need to see entire data in the tabular visual so i don't have option to filter it based Year/Quarter.
Do you have any other recommendation?
I am trying incremental but there will be lot of effort in old system where the data comes from.
Also can you elaborate
You can only refresh a certain number of datasets at a time, varying based on the number of capacities purchased.
You're welcome! I'm still learning too, but been around the product ~4 years now.
I recommend splitting your tables into a Star Schema. It'll take more work up front but will much improve the performance of the reports. Making no assumptions of your knowledge, here's an explanation: Power BI Basics of Modeling: Star Schema and How to Build it - RADACAD
A warning - if you don't do a star schema, slicers might be really slow. When you open them, they scan the entire table for distinct values you can slice the data by.
Incremental Refresh should make your refreshes much faster - if you can update just yesterday or the past week everything will run very quickly up front. The data engine in PBI (VertiPaq) can handle huge data loads. 4m rows isn't going to swamp it.
Data refreshes -
If you are on Pro or PPU plans (I think; I've never used PPU), your data will refresh in the "shared" capacity - meaning it might take a little longer before the system pushes you through the queue. Generally that's not an issue, but don't expect it to let you do all 50 datasets at once.
If you have Premium, you'll have purchased a capacity or multiple. Those plans range from A1 to A6, with each having a different number of "vCores", basically processing power. Use "Backend vCores" * 1.5 (rounded up) to see the max # of concurrent refreshes on Premium.
More Pro vs PPU vs Premium comparison:
Pricing & Product Comparison | Microsoft Power BI
Best,
In case of incremental refresh, do i have the ability to change Incremental Refresh settings after it has been published in BI Service. How this will take effect once i make the changes?