Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
5 years ago

Data outside the range parameter of incremental refresh changes

I pull my data with Odata feed, after i create parameters for the incremental refresh, Then i refresh the table -> Its seem that data outside the range changes also, is that mean the Incremental refr...
Need Help
selimovd's avatar
selimovd
Icon for Most Valuable Professional rankMost Valuable Professional
5 years ago

Hey Anonymous ,

 

when you set up an incremental refresh, you define a time window that should be refreshed and a time frame that should be kept. For example, keep the data of the last 5 years and refresh the last 2 weeks.

For every refresh only the last 2 weeks will be refreshed. If you have changes 3 weeks ago, they will not appear in your data set as they are out of the refresh window. In this case you have to expand the window or define that changes after a certain amount will not be considered.

 

The refresh window is a rolling window by the way. So every day the window moves by one day. In 2 weeks the data until today will be refreshed. But I guess that was clear.

 

If you need any help please let me know.
If I answered your question I would be happy if you could mark my post as a solution ✔️ and give it a thumbs up 👍
 
Best regards
Denis
 
  • Anonymous's avatar
    Anonymous
    Not applicable
    5 years ago

    Thanks selimovd, I will explane myself again:
    Even if i put:
    Store 5 years
    refresh 2 weeks
    data that older then the last 2 weeks will also update...
    Infact, all of our Data is updated....

    • selimovd's avatar
      selimovd
      Icon for Most Valuable Professional rankMost Valuable Professional
      5 years ago

      Hey Anonymous ,

       

      sorry, thought that was a question about the time window 😉

       

      Can you check in your query if the steps where you filter by date are still in query folding? Can you make sure that the column you filter has the date format and that the parameters are called RangeStart and RangeEnd?

       

      See the details about incremental refresh here:

      https://docs.microsoft.com/en-us/power-bi/connect-data/incremental-refresh-overview#supported-data-sources

       

      If you need any help please let me know.
      If I answered your question I would be happy if you could mark my post as a solution ✔️ and give it a thumbs up 👍
       
      Best regards
      Denis
       
      • Anonymous's avatar
        Anonymous
        Not applicable
        5 years ago

        selimovd The data that come from the Odata feed is in Date/time/timezone format so i create new column with the function DateTimeZone.RemoveZone([oldDate]), then i change the column type to Date/Time and filter thos column with RangeStart & RangeEnd, when i look in the 'Diagnose step' on the new column - the HTTP request does not use $filter, But the filter on the new column is working fine.

        In every step the 'View Native Query' is disabled, but i still get the 'Unable to confirm if the M query can be folded...'