Forum Discussion
Incremental Refresh
I am trying to test incremental refresh and in my power query i have data from January 1 2024 until today. I also have set up parameters (RangeStart and RangeEnd) to be between April 1 - April 9. I also have set up custom filter to filter data between these two dates. After this i have done "close and apply" to load this into my model where I also have set up increment policy (see attached) and published it in service. After this I did refresh in my model in desktop but in service I only see data for April and dont see any data from Jan, Feb and March. Any sugestions on what I am doing wrong?
53 Replies
partitions are filled on the second refresh.
Yes. I am telling you that is way too late.
I am not disputing that fact. all I am saying that i only have lines between rows 37-50. My first 36 lines of code is juust code related to API call that gets the data.
That's exactly the point. If you make the parameters part of your API call filters then you can implement your own query folding.
I followed multiple tutorials online about this and I thought I did everything in order. Can you look at this code (see image) and maybe suggest how to adjust it because your last post kind of confused me because I do have date parametars in my query as I am requesting data from jan 1 until today but only want last few dats to be live and eveything else to be archive so it doesnt need to be refetched on every refresh since that data never changes
Assign RangeEnd to currentdate and RangeStart to previousdate.
Not sure which tutorials you refer to, but this one here is pretty good.
Troubleshoot incremental refresh and real-time data in Power BI - Power BI | Microsoft Learn
But assigning previous and current date for those values will call API endpoint and get data from April 1 to
today. How would I get data from Jan - March?
I can't. because RangeStart and RangeEnd won't accept datetimes like these yyyy-MM-ddTHH:mm:ss-04:00 and API endpoint requires datetime in this format
ok sorry about the delay on this. This is what I have now. (see the images). Please let me know if this looks good to get data from January 1 to today and how many times i have to refresh to set up the archives
my numbers in visual in Desktop and Service do not match. I saw some posts where dates in Service are in UTC
I almost just about finished. I was wondering how to make this RangeEnd parameter to always be the current todays date
