Forum Discussion

powerbiexpert22's avatar
powerbiexpert22
Icon for Impactful Individual rankImpactful Individual
15 hours ago

Incremental Refresh Decision

I am creating fresh (new) semantic model, I am not sure whether I should implement incremental refresh now or later point of time . I do not want to change or overwrite semantic model once it move to...
Need Help
power bi
powerbiexpert22's avatar
powerbiexpert22
Icon for Impactful Individual rankImpactful Individual
9 hours ago

Hi krishnakanth240​ 

 

What is the current and expected data volume/row count: current -1 million rows, expected 100-500 rows per day 

How much historical data needs to be retained : last 5 years

How frequently is the data refreshed: Daily

What is the source system: Databricks

Is query folding supported for the date/time filter: Yes

Is the data append-only or can historical records be updated/deleted: historical can be updated/deleted

  • krishnakanth240's avatar
    krishnakanth240
    Icon for Super User rankSuper User
    4 hours ago

    Hi powerbiexpert22​ 

    Since historical records can change, you can configure Incremental Refresh and Detect data changes instead seeing the table as append only.

    You can validate it in Dev/Test first then deploy tested semantic model to Production which avoids having to introduce the refresh architecture as model is already in production

    Given the low daily growth, incremental refresh is useful because of 5-year historical window and potential updates/deletes to historical data.