Forum Discussion
How Power BI update the record!
Confused about how PBI update the record in scheduled refresh.I read in article that it refresh only updates and does not refresh whole data again (and it's making sense to me as in case of data in GB ideally it should not refresh whole data.) but again another thing clicked in mind if it refresh only updates in Powerbi.com then why we have a new feature of Incrementle refresh.
Please clarify this issue!
hi,@pundiv01
You have a misconception about scheduled refresh.
When you refresh data, you are updating the data in the dataset that is stored in Power BI from your data source. This refresh is a full refresh and not incremental.
reference:https://docs.microsoft.com/en-us/power-bi/refresh-data
For example:
We import a table with three columns, If data in column1 updated, when it refreshed in power bi, it will refresh
all the data in three columns not just only refresh cloumn1.
Incremental refresh enables very large datasets in the Power BI Premium service with the following benefits:
Refreshes are faster. Only data that has changed needs to be refreshed. For example, refresh only the last 5 days of a 10-year dataset.
Refreshes are more reliable. For example, it is not necessary to maintain long-running connections to volatile source systems.
Resource consumption is reduced. Less data to refresh reduces overall consumption of memory and other resources.
Reference:https://docs.microsoft.com/en-us/power-bi/service-premium-incremental-refresh
For example:
Assume that we have a data source include 5 years data, if we don't use Incremental refresh, it will check and refresh all the data,this needs high performance requirements and lots of time.
but if we use Incremental refresh, we can define that it only check and refresh last 10 days data.
Regards,
Lin
2 Replies
v-lili6-msftCommunity Support
hi,@pundiv01
You have a misconception about scheduled refresh.
When you refresh data, you are updating the data in the dataset that is stored in Power BI from your data source. This refresh is a full refresh and not incremental.
reference:https://docs.microsoft.com/en-us/power-bi/refresh-data
For example:
We import a table with three columns, If data in column1 updated, when it refreshed in power bi, it will refresh
all the data in three columns not just only refresh cloumn1.
Incremental refresh enables very large datasets in the Power BI Premium service with the following benefits:
Refreshes are faster. Only data that has changed needs to be refreshed. For example, refresh only the last 5 days of a 10-year dataset.
Refreshes are more reliable. For example, it is not necessary to maintain long-running connections to volatile source systems.
Resource consumption is reduced. Less data to refresh reduces overall consumption of memory and other resources.
Reference:https://docs.microsoft.com/en-us/power-bi/service-premium-incremental-refresh
For example:
Assume that we have a data source include 5 years data, if we don't use Incremental refresh, it will check and refresh all the data,this needs high performance requirements and lots of time.
but if we use Incremental refresh, we can define that it only check and refresh last 10 days data.
Regards,
Lin