Forum Discussion

hemamaleni's avatar
hemamaleni
Helper I
3 years ago

incremental refresh doesn't import historical data

I have a fact table with start_year (2023) and end_year parameter(2023). I also have incremental refresh set with RangeStart as 1/1/2018 to RangeEnd as 01/01/24. I want to hold last 5 years data and ...
Need Help
ppm1's avatar
ppm1
Solution Sage
3 years ago

A few things to confirm:

1. Did you use RangeStart and RangeEnd as filters in your query?

2. Did you set up incremental refresh on your fact table through the UI in Power BI Desktop before you published it? 

3. Why do you use the start and end year parameters? you shouldn't need those. Once you publish it, the Power BI service automatically manages your partitions through the RangeStart and RangeEnd parameter.

 

Pat

 

  • hemamaleni's avatar
    hemamaleni
    Helper I
    3 years ago

    1. Did you use RangeStart and RangeEnd as filters in your query? - Yes

    2. Did you set up incremental refresh on your fact table through the UI in Power BI Desktop before you published it? - Yes

    3. Why do you use the start and end year parameters? you shouldn't need those. Once you publish it, the Power BI service automatically manages your partitions through the RangeStart and RangeEnd parameter.  - I would like to reduce the size of the file by limiting to only 5 years and it should dynamically pick the last five years from today. I believe if I dont do that it will accumulate the data starting from 2019. 

     

    I tried to change the Start_year parameter to 2019 in Power BI desktop and imported all data before publishing it. Then change the Start_year parameter to 2020 and refreshed the file. It did eliminate the 2019 data but when reversed the Start_year parameter to 2019, it didn't bring any data back from 2019.  Any idea why?

    • hemamaleni's avatar
      hemamaleni
      Helper I
      3 years ago