Forum Discussion

Abhilash_P's avatar
Abhilash_P
Icon for Super User rankSuper User
2 years ago

IIncremental Refresh failure with minimal data load and full data load

Hi Everyone, I have created below parameters in power query and trying to apply incremental refresh but not able execute incremental refresh. IsMinimalLoad / IsMinimalLoadValue parameter is used to...
Need Help
Abhilash_P's avatar
Abhilash_P
Icon for Super User rankSuper User
2 years ago

Hi lbendlin ,
Below is the snapshot for RangeStart and RangeEnd

 

 

Below are the Power query steps

Below is the code in advance editor

 

lbendlin's avatar
lbendlin
Icon for Super User rankSuper User
2 years ago

RangeStart and RangeEnd cannot both be inclusive.  One (usually RangeStart) needs to be inclusive, the other (usually RangeEnd) needs to be exclusive.  Otherwise you duplicate data across partitions.

  • Abhilash_P's avatar
    Abhilash_P
    Icon for Super User rankSuper User
    2 years ago

    Hi lbendlin  ,
    Thanks for the reply
    I have changed RangeEnd to < insted of <=
    Still not able to perform incremental refresh

     


    I am using Azure databricks as my source and query folding is disabled

    Did you have any reference on implementing Incremental refresh with data bricks as the source..?
    Thanks a lot your response.

     

     

    • lbendlin's avatar
      lbendlin
      Icon for Super User rankSuper User
      2 years ago

      What is your interpretation of "failure" ?

       

      An incremental Refresh setup is considered "failed"  if you keep having a single partition.  As soon as you see multiple partitions on your table that means Incremental Refresh is successful.