Forum Discussion
Using Power Query to keep Refresh data without overwriting existing data?
Hi
I am looking to import a data value from a web page each day on daily scheduled refresh, but i am looking for each data refresh to store each refresh so the the next daily refresh will create a new row of data with the the updated value and the new refresh date,
However when i tried this by adding adding a custome column of DateTime.LocalNow() function, the fresh still keeps overwring the old refresh with the new updated data refresh... there must be a way with in Power Query to successfully keep refreshed data with it overwriting?
Cheers
Dan
No, there is not.
Power BI has no memory* . You need to manage your snapshots in the upstream system. * Yes, there is the self referencing option but that has no safety net.
2 Replies
Hi 1Dan_Crowther ,
lbendlin is correct, Power Query is not a data warehouse and is not designed to retain data beyond its immediate use as standard. However, you could look into using Incremental Refresh, although this comes with its own significant caveats: https://learn.microsoft.com/en-us/power-bi/connect-data/incremental-refresh-overview
Pete
No, there is not.
Power BI has no memory* . You need to manage your snapshots in the upstream system. * Yes, there is the self referencing option but that has no safety net.
