Incremental refresh using State column

[niki_1414]

Hello , 

I am new to Power BI and this community.

I have a Power BI dataset fetching data from Snowflake, which has about 70M rows and growing, I would like to know if there is a possibility to set incremental refresh on dataset based on Integer column as Once that column reaches to State '20' or '22' they will not be modified further.

TIA

[rajendraongole1 · Accepted solution]

Hi @niki_1414 - Yes, you can set up incremental refresh in Power BI using integer values as criteria! Incremental refresh typically requires a Date or DateTime column for filtering, but you can implement a workaround in your case with an integer column.

Since Power BI requires a range-based filtering approach for incremental refresh, you can set it up to refresh only rows where the integer status column value is less than 20 (or any number before it reaches the final states 20 or 22). Rows with these values can be excluded from future refreshes.

Power Query Filtering:

Go to Power Query Editor and apply a custom filter to your integer column so that it only loads data where the status is not in the final state (e.g., Status < 20).
This way, only records with modifiable states will be included in each refresh, while rows with statuses 20 and 22 remain static in the Power BI cache and don’t get reloaded.
Enable Incremental Refresh:

Set up Incremental Refresh in Power BI by defining the policy with the Date or DateTime column (if available) for partitioning.
Use this Date/DateTime column just to define refresh partitions, but your filter on the integer status column will limit which rows actually get reloaded.

Reference links:

How to Implement Incremental Refresh in Power BI | phData

Aggregated Intelligence: Understanding PowerBi Incremental Refresh with Detect Changes