Problem with Incremental Refresh

[pbi1908]

Hi everyone, 

I have a table like the one below and i set an Incremental Refresh so i will Incrementally Refresh the Data of the last 15 days. Also i set to Detect the Data Changes according to Last Update Date. When i add a new row in the table with creation date today the table is not updated with the new row. If i modify something and i update the Last Update Date is detecting the Data Change normally. 

So i really can't understand why is not taking the new row and i really have doubts if i can trust the incremental refresh to production in which i will have a lot of data and would be more difficult for me to check the quality.

CREATION DATE   |   PRICE   |    LAST UPDATE DATE

--------------------------------------------------------------------

02/01/2023          |     567     |           NULL

01/01/2023          |     500     |           NULL

12/12/2022          |     147     |       31/12/2022

[Anonymous · Accepted solution]

Hi @pbi1908 ,

• Problem: Report visuals don’t show the latest data
• Cause: Power BI caches query results improve performance and reduce back-end load

By default, Power BI caches query results, so that queries of report visuals can be processed quickly even if they're based on DirectQuery. Avoiding unnecessary data source queries improves performance and reduces data source load, but it might also mean that the latest data changes at the source are not included in the results.

• Solution: Configure automatic page refresh

To keep fetching the latest data changes from the source, configure automatic page refresh for your reports in the Power BI service. Automatic page refresh can be performed in fixed intervals, such as five seconds or ten minutes. When that specific interval is reached, all visuals in that page send an update query to the data source and update accordingly. Alternatively, you can refresh visuals on a page based on detecting changes in the data. This requires a change detection measure that Power BI then uses to poll the data source for changes. Change detection is only supported in workspaces that are part of a Premium capacity. 

Troubleshoot incremental refresh and real-time data in Power BI - Power BI | Microsoft Learn

Best Regards
Community Support Team _ Polly

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[lbendlin]

Also i set to Detect the Data Changes according to Last Update Date

I would recommend you have a look at the tables that are being created for that. Look for tables with "canary" in their name. Also *

Is this a data source in a dataset or in a dataflow?

* Here's a link to the documentation:

Select Detect data changes to specify a date/time column used to identify and refresh only the days where the data has changed. A date/time column must exist, usually for auditing purposes, at the data source. This should not be the same column used to partition the data with the RangeStart and RangeEnd parameters. The maximum value of this column is evaluated for each of the periods in the incremental range. If it has not changed since the last refresh, the current period is not refreshed. For datasets published to Premium capacities, you can also specify a custom query. To learn more, see Advanced incremental refresh - Custom queries for detect data changes.