Forum Discussion
Incremental Refresh Woes
Hello v-yingjl . It turns out that the nature of this data is such that at least 1 row from virtually all historical partitions gets updated each day (thereby causing all partions--the whole data table--to be refreshed each day). In addition, the field I was using for Detect Data Changes was not indexed. Those 2 factors amounted to combo knockout punch, so to speak. So I've stopped using Detect Data Changes for now until the DBAs can add the correct update field and index it. That will at least address 1 of the 2 factors; can't do much about so much of the past getting updated everyday. If that's not enough then I will just abandon the Detect Data Changes option and possibly even IR altogether.
Hi robarivas ,
If you've fixed the issue on your own please kindly share your solution. If the above posts help, please kindly mark it as a solution to help others find it more quickly. Thanks!
Best Regards,
Yingjie Li
Hello v-yingjl . It turns out that the nature of this data is such that at least 1 row from virtually all historical partitions gets updated each day (thereby causing all partions--the whole data table--to be refreshed each day). In addition, the field I was using for Detect Data Changes was not indexed. Those 2 factors amounted to combo knockout punch, so to speak. So I've stopped using Detect Data Changes for now until the DBAs can add the correct update field and index it. That will at least address 1 of the 2 factors; can't do much about so much of the past getting updated everyday. If that's not enough then I will just abandon the Detect Data Changes option and possibly even IR altogether.