Forum Discussion
Incremental refresh understanding
Hai,
as a newbie looking for some understanding of incremental refresh. Read about it, watched a video, but want some confirmation.
We have fact tables and dimensions. In our coming architecture I presume "Import data" will be our first option.
Refreshing fact tabless by using the two parameters RangeStart and RangeEnd will work fine, I presume.
It will for instance only add the facts of the last day.
But how does it work with dimensions? We have a table with agreements, roundabout 10 million. Every row has a field called Last-Changed-Date. If I enable for this table Detect Data Changes, does that mean it will only refresh those rows where the Last-Changed-Date has changed?
Are there more issues I should consider concerning refresh?
Thnx Ron
1 Reply
Hi Anonymous ,
The following requirements need to be satisfied if need incremental refresh to work:
- The data source must support “query folding”
- The filter only applies to date time column
When you can enable the option "Detect Data Changes" and choose the field Last-Changed-Date, then the process of incremental refresh can monitor this field, and only get rows that the date/time is after the latest date/time in this field in the previous refresh. You can review the contents in the following links for more details.
All You Need to Know About the Incremental Refresh in Power BI: Load Changes Only
Power BI Incremental Refresh - Understanding Detect Data Changes
Best Regards
Rena