Forum Discussion
Incremental Refresh and dataflows to save historic data
Hi All,
I'm trying to use dataflows and incremental refresh to get and save data from an external API.
I've created a dataflow (A) where I'm accessing the API to pull the most recent data, this dataflow is refreshed once a week.
I've created another dataflow (B) using dataflow A as it’s source, and set up incremental refresh to refresh data from the past 2 days and keep data for 16 months. This refresh occurs once a week, on the following day to dataflow A's refresh.
The problem is: data flow B keeps being overwritten with the most recent data a from dataflow A, the previous data is not saved at all.
I'm not sure why this doesn't work, maybe it's related to dataflow A being a 'linked entity' in dataflow B, and then referenced?
I have Incremental refresh working in a completely different dataflow, so I thought I had it figured out, obviously I was wrong 🙂
Should this work? not sure if there is something I'm missing in setting up these dataflows, or if I need to completely change my approach?
Thank you for your help!
1 Reply
- v-yanjiang-msftCommunity Support
Hi Yaa_D ,
Please refer to the below documents:
Storing and using information from a dynamic data source using PBI desktop.
Historical Data Preservation using Power BI Dataflow
Keep The Existing Data In Your Power BI Dataset And Add New Data To It Using Incremental Refresh
Hope it helps!
Best Regards,
Community Support Team _ kalyjIf this post helps, then please consider Accept it as the solution to help the other members find it more quickly.