Forum Discussion
how to archive data
I have pro licence . I want to store data every month as historical data. I know incremental refresh can do but I dont have preimum licence. what is the best way to store data. I want to run to get new data and put in historical table.
4 Replies
Hi. Just to be clear, Incremental refresh is a way to build faster refresh for big data analysis purpose. If the idea is just a place to store the data, you should think about other service. The way to store it depends on the type and size of the data. If you have big data use a data lake, if you have structure data you can store it on a DB or if you have excel files you can use sharepoint/onedrive by year-month folders.
Consider that the incremental refresh will only work for refreshes, each time you must change something and publish back it needs to refresh all over again, so the history might be lost if you are not storing at other place.
Now that I have answer that I can say that you can do incremental refresh with just pro licence for datasets.
I hope that helps,
Thanks for your response. I want my data to get refreshed every day but when period ends it should store data no more changes after perid ends. Then I want my new data to refresh for new period every day then next period comes to end then it should store to previous data. It should contiue for every period. I hope you understand
I'm not quite sure I'm following the idea of the periods, but you can check this videos that will show how to set up your incremental refresh.
https://www.youtube.com/watch?v=BQahH53ayKUhttps://www.youtube.com/watch?v=Kui_1G6kQIQ
I hope that helps,
