IIncremental Refresh failure with minimal data load and full data load

[Abhilash_P]

Hi Everyone,
I have created below parameters in power query and trying to apply incremental refresh but not able execute incremental refresh.
IsMinimalLoad / IsMinimalLoadValue parameter is used to load minimul data into Power BI desktop.

DataSource for the report is Databricks,
Below are the applies steps
Native queries option is active till Rawdata step

[Abhilash_P]

Hi @lbendlin ,
Below is the snapshot for RangeStart and RangeEnd

Below are the Power query steps

Below is the code in advance editor

[lbendlin]

RangeStart and RangeEnd cannot both be inclusive.  One (usually RangeStart) needs to be inclusive, the other (usually RangeEnd) needs to be exclusive.  Otherwise you duplicate data across partitions.

[Abhilash_P]

Hi @lbendlin  ,
Thanks for the reply
I have changed RangeEnd to < insted of <=
Still not able to perform incremental refresh

I am using Azure databricks as my source and query folding is disabled

Did you have any reference on implementing Incremental refresh with data bricks as the source..?
Thanks a lot your response.

[lbendlin]

What is your interpretation of "failure" ?

An incremental Refresh setup is considered "failed"  if you keep having a single partition.  As soon as you see multiple partitions on your table that means Incremental Refresh is successful.

[lbendlin]

is this a dataset or a dataflow?  You are seemingly missing the step where it filters for RangeStart/RangeEnd.

What is your interpretation of "failure" ?

[Abhilash_P]

Hi @lbendlin,
It's a dataset and tried applying filters (RangeStart and RangeEnd) but data is not being filtered as i have used select statement.

[lbendlin]

That should work. Please show a sanitized version of your Power Query code.