Forum Discussion
Incremental refresh
Hi Anonymous ,
- If you select the Detect data changes checkbox, you can select a date/time column used to identify and refresh only the days where the data has changed. This should not be the same column used to partition the data with the RangeStart/RangeEnd parameters.
- If you configure the incremental update to Update rows where column OrderDate is in the last 30 days, it means if something has changed in the data source 40 days ago, it will not be included in the updates.
Best Regards,
Yingjie Li
If this post helps then please consider Accept it as the solution to help the other members find it more quickly.
Thank you for your reply. I have some more questions.
1. If I have only one date column, such as OrderDate, and I applied the "RangeStart" and "RangeEnd" parameters on this column, can I use OrderDate to configure "detect data changes" or is there any other option? for example, duplicate OrderDate and use it to configure to detect data changes
2. If I configure the incremental update to Update rows where column OrderDate is in the last 30 days, does it mean if something has changed in the data source 40 days ago, will it not be included in the updates?
Thanks in advance!
Hi Anonymous ,
- If you select the Detect data changes checkbox, you can select a date/time column used to identify and refresh only the days where the data has changed. This should not be the same column used to partition the data with the RangeStart/RangeEnd parameters.
- If you configure the incremental update to Update rows where column OrderDate is in the last 30 days, it means if something has changed in the data source 40 days ago, it will not be included in the updates.
Best Regards,
Yingjie Li
If this post helps then please consider Accept it as the solution to help the other members find it more quickly.