Forum Discussion
Historize data from dataflow
- 3 years ago
That is odd that you can't get past data. In that case, I would use Power Automate to call the API every day and write the data to a csv (with the date in the filename). You can then use incremental refresh to combine those csv files (not required, but it will speed it up significantly once you get a lot of them).
Pat
Please see these two examples of potential approaches to do this. Hopefully, your API support date filtering/folding and it will be easy. Otherwise, you'll have to use the RangeStart and RangeEnd parameters to create a table of dates and then add the API call on each role, concatenating the date formatted as text into the URL filter.
Power BI incremental data refresh with JSON REST API - BecTec Solutions
Pat
Thanks for the suggestions ppm1 !
Unfortunately, the API does not allow to get data from the past (e.g. to call data from last month). It only delivers the current real-time data from the system. Is incremental refresh also in this case the way to go to build a database with historic data (data from yester, day before yester, etc.)?
- ppm13 years agoSolution Sage
That is odd that you can't get past data. In that case, I would use Power Automate to call the API every day and write the data to a csv (with the date in the filename). You can then use incremental refresh to combine those csv files (not required, but it will speed it up significantly once you get a lot of them).
Pat