Forum Discussion

pbi1908's avatar
pbi1908
Helper III
3 years ago
Solved

Problem with Incremental Refresh

Hi everyone,    I have a table like the one below and i set an Incremental Refresh so i will Incrementally Refresh the Data of the last 15 days. Also i set to Detect the Data Changes according to L...
Need Help
  • Anonymous's avatar
    Anonymous
    3 years ago

    Hi pbi1908 ,

    • Problem: Report visuals don’t show the latest data
    • Cause: Power BI caches query results improve performance and reduce back-end load

    By default, Power BI caches query results, so that queries of report visuals can be processed quickly even if they're based on DirectQuery. Avoiding unnecessary data source queries improves performance and reduces data source load, but it might also mean that the latest data changes at the source are not included in the results.

    • Solution: Configure automatic page refresh

    To keep fetching the latest data changes from the source, configure automatic page refresh for your reports in the Power BI service. Automatic page refresh can be performed in fixed intervals, such as five seconds or ten minutes. When that specific interval is reached, all visuals in that page send an update query to the data source and update accordingly. Alternatively, you can refresh visuals on a page based on detecting changes in the data. This requires a change detection measure that Power BI then uses to poll the data source for changes. Change detection is only supported in workspaces that are part of a Premium capacity. 

     

    Troubleshoot incremental refresh and real-time data in Power BI - Power BI | Microsoft Learn

     

    Best Regards
    Community Support Team _ Polly

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

     

     

     

lbendlin's avatar
lbendlin
Super User
3 years ago

 

 

Also i set to Detect the Data Changes according to Last Update Date

 

 

I would recommend you have a look at the tables that are being created for that. Look for tables with "canary" in their name. Also *

 

Is this a data source in a dataset or in a dataflow?

 

* Here's a link to the documentation:

Select Detect data changes to specify a date/time column used to identify and refresh only the days where the data has changed. A date/time column must exist, usually for auditing purposes, at the data source. This should not be the same column used to partition the data with the RangeStart and RangeEnd parameters. The maximum value of this column is evaluated for each of the periods in the incremental range. If it has not changed since the last refresh, the current period is not refreshed. For datasets published to Premium capacities, you can also specify a custom query. To learn more, see Advanced incremental refresh - Custom queries for detect data changes.

wanthanaj's avatar
wanthanaj
Advocate I
1 year ago

Hi lbendlin 

 

What is a canary table in dataflow? I can't find any document about it.

My incremental refresh shows as successful but data is not up-to-date. I noticed a table ended with "canary" generated in my dataflow but can't load. 

Cheers,
Wanthana
 

  • lbendlin's avatar
    lbendlin
    Super User
    1 year ago
    I can't find any document about it.

    Interesting, isn't it? As if someone wants to hide the fact that these use extra storage and memory.

     

    Dataflow incremental refresh is still a black box. There is no sure way to know if it is actually working, there are only assumptions.