Forum Discussion

PhillipWeeks's avatar
PhillipWeeks
Frequent Visitor
3 years ago
Solved

Incremental Refresh Woes

Hello All,  I've been trying to get incremental refresh working for a while now with no success.  I successfully create parameters RangeStart and RangeEnd and the date column in my table is a date/ti...
Need Help
  • PhillipWeeks's avatar
    PhillipWeeks
    3 years ago

    I did have <= RangeEnd and did not know there was an issue with this logic.  However, I will remove the =, republish and compare the incremental refresh total to the scheduled full refresh in the service tomorrow.
    I've tested this now with our 35 million rows data set and this was indeed the issue. 
     This did correctly update the data set in a record 1 minute time! So Thank you!

     

ppm1's avatar
ppm1
Solution Sage
3 years ago

I would compare row counts and min/max of dates to see where the difference lies. Then compare values at the date level to see which have missing/extra rows.

 

Also, did you confirm you have >= RangeStart and < RangeEnd (people often put <= and get duplicate rows).

 

Pat

 

PhillipWeeks's avatar
PhillipWeeks
Frequent Visitor
3 years ago

I did have <= RangeEnd and did not know there was an issue with this logic.  However, I will remove the =, republish and compare the incremental refresh total to the scheduled full refresh in the service tomorrow.
I've tested this now with our 35 million rows data set and this was indeed the issue. 
 This did correctly update the data set in a record 1 minute time! So Thank you!