Forum Discussion
Need dataflow to incrementally refresh from fixed start date rather than rolling time period.
Hi, Mark_Ritter ;
May be you could try to Advanced incremental refresh and real-time data with the XMLA endpoint.
https://docs.microsoft.com/en-us/power-bi/connect-data/incremental-refresh-xmla
https://docs.microsoft.com/en-us/power-query/dataflows/incremental-refresh
https://www.youtube.com/watch?v=JsJWBr1_ktQ
Best Regards,
Community Support Team _ Yalan Wu
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
There is a way to do this. Let's say you want data from 1/1/2019 to always be present. So for yearly archived partitions, you want the process to always add years but never remove 2019, 2020, etc.
The idea is to ask for a large number of years to be archived, such that 2019 is far from the initial year. Let's say you ask for 20 years. That would make the first partition be 2006 (it's now 2025). This ensures that the 2019 partition won't be wiped out until about 2038 (if your report is still around, then you're a genius).
Since you don't want any data from before 2019, you then modify the filtering step in your query to prevent loading data into the partitions between 2006 and 2018. For example, if your filtering step is currently like this:
[CREATE_DATE] > RangeStart
and [CREATE_DATE] <= RangeEnd
change it to
[CREATE_DATE] > RangeStart
and [CREATE_DATE] <= RangeEnd
and [CREATE_DATE] >= StartDate
where StartDate is 1/1/2019. The partitions will be created but they will be empty.