Forum Discussion

Abhilash_P's avatar
Abhilash_P
Icon for Super User rankSuper User
2 years ago

IIncremental Refresh failure with minimal data load and full data load

Hi Everyone, I have created below parameters in power query and trying to apply incremental refresh but not able execute incremental refresh. IsMinimalLoad / IsMinimalLoadValue parameter is used to...
Need Help
Abhilash_P's avatar
Abhilash_P
Icon for Super User rankSuper User
2 years ago

Hi lbendlin ,
Below is the snapshot for RangeStart and RangeEnd

 

 

Below are the Power query steps

Below is the code in advance editor

 

  • lbendlin's avatar
    lbendlin
    Icon for Super User rankSuper User
    2 years ago

    RangeStart and RangeEnd cannot both be inclusive.  One (usually RangeStart) needs to be inclusive, the other (usually RangeEnd) needs to be exclusive.  Otherwise you duplicate data across partitions.

    • Abhilash_P's avatar
      Abhilash_P
      Icon for Super User rankSuper User
      2 years ago

      Hi lbendlin  ,
      Thanks for the reply
      I have changed RangeEnd to < insted of <=
      Still not able to perform incremental refresh

       


      I am using Azure databricks as my source and query folding is disabled

      Did you have any reference on implementing Incremental refresh with data bricks as the source..?
      Thanks a lot your response.

       

       

      • lbendlin's avatar
        lbendlin
        Icon for Super User rankSuper User
        2 years ago

        What is your interpretation of "failure" ?

         

        An incremental Refresh setup is considered "failed"  if you keep having a single partition.  As soon as you see multiple partitions on your table that means Incremental Refresh is successful.