Forum Discussion

Abhilash_P's avatar
Abhilash_P
Icon for Super User rankSuper User
2 years ago

IIncremental Refresh failure with minimal data load and full data load

Hi Everyone, I have created below parameters in power query and trying to apply incremental refresh but not able execute incremental refresh. IsMinimalLoad / IsMinimalLoadValue parameter is used to...
Need Help
lbendlin's avatar
lbendlin
Icon for Super User rankSuper User
2 years ago

RangeStart and RangeEnd cannot both be inclusive.  One (usually RangeStart) needs to be inclusive, the other (usually RangeEnd) needs to be exclusive.  Otherwise you duplicate data across partitions.

Abhilash_P's avatar
Abhilash_P
Icon for Super User rankSuper User
2 years ago

Hi lbendlin  ,
Thanks for the reply
I have changed RangeEnd to < insted of <=
Still not able to perform incremental refresh

 


I am using Azure databricks as my source and query folding is disabled

Did you have any reference on implementing Incremental refresh with data bricks as the source..?
Thanks a lot your response.

 

 

  • lbendlin's avatar
    lbendlin
    Icon for Super User rankSuper User
    2 years ago

    What is your interpretation of "failure" ?

     

    An incremental Refresh setup is considered "failed"  if you keep having a single partition.  As soon as you see multiple partitions on your table that means Incremental Refresh is successful.