The ultimate Fabric, Power BI, SQL, and AI community-led learning event. Save €200 with code FABCOMM.
Get registeredEnhance your career with this limited time 50% discount on Fabric and Power BI exams. Ends August 31st. Request your voucher.
I have pro licence . I want to store data every month as historical data. I know incremental refresh can do but I dont have preimum licence. what is the best way to store data. I want to run to get new data and put in historical table.
Hi. Just to be clear, Incremental refresh is a way to build faster refresh for big data analysis purpose. If the idea is just a place to store the data, you should think about other service. The way to store it depends on the type and size of the data. If you have big data use a data lake, if you have structure data you can store it on a DB or if you have excel files you can use sharepoint/onedrive by year-month folders.
Consider that the incremental refresh will only work for refreshes, each time you must change something and publish back it needs to refresh all over again, so the history might be lost if you are not storing at other place.
Now that I have answer that I can say that you can do incremental refresh with just pro licence for datasets.
I hope that helps,
Happy to help!
Thanks for your response. I want my data to get refreshed every day but when period ends it should store data no more changes after perid ends. Then I want my new data to refresh for new period every day then next period comes to end then it should store to previous data. It should contiue for every period. I hope you understand
I'm not quite sure I'm following the idea of the periods, but you can check this videos that will show how to set up your incremental refresh.
https://www.youtube.com/watch?v=BQahH53ayKU
https://www.youtube.com/watch?v=Kui_1G6kQIQ
I hope that helps,
Happy to help!
1/1/2023 to 1/31/2023 period 1
2/1/2023 to 2/28/2023 period 2
3/1/2023 to 3/31/2023 period 3
....... so on