Hi everyone,
Is it possible use the Incremental Refresh using the sequencial number instead of date?
I am working in one project that using data with trillions of line and when the module is update the server crash.
I was using the transaction date as a parameter to do the incremental refresh and unfortunatelly for a lot of reason this date can not be using as a parameter. So, the DBA told me that the best away to refresh the data is by using the sequencial number as a paramter.
I need to find one solution to store the rows from the last 4 or 5 years and just refresh the data based on the last sequencial number. As I can show in the example below:
COMPANY |TRANSACTION DATE |SEQUENCIAL NUMBER|AMOUNT
TEST1 |01-01-17 |127953 | 1
TEST1 |01-01-17 |127954 | 1
TEST1 |01-01-17 |127955 | 1
TEST1 |01-01-18 |127956 | 1
TEST1 |01-01-18 |127957 | 1
TEST1 |01-01-18 |127958 | 1
TEST1 |01-01-19 |127959 | 1
TEST1 |01-01-19 |127960 | 1
TEST1 |01-01-19 |127961 | 1
TEST1 |01-01-20 |127962 | 1
TEST1 |01-01-20 |127963 | 1
TEST1 |01-01-20 |127964 | 1
TEST1 |01-01-21 |127965 | 1
TEST1 |01-02-21 |127966 | 1
TEST1 |19-04-21 |127967 | 2
TEST1 |19-04-21 |127968 | 2
TEST1 |20-04-21 |127969 | 2
On this cenario the last sequencial was 127968 and I whould like that the refresh just happend from
the next sequencial number which is "127969" . So the module should keep all the data from 127953 to 127968 and refresh just the next sequencial number.
I tried to use a incremental refresh by using the sequencial number as parameter list but it dont works, or I didnt did the correct steps.
Is the are any solution for this case?
Can you please help me? I`m stuck trying to find this solution
Note: As the information is confidential I cant share the data.
Thanks
