- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Using Power Query to keep Refresh data without overwriting existing data?
Hi
I am looking to import a data value from a web page each day on daily scheduled refresh, but i am looking for each data refresh to store each refresh so the the next daily refresh will create a new row of data with the the updated value and the new refresh date,
However when i tried this by adding adding a custome column of DateTime.LocalNow() function, the fresh still keeps overwring the old refresh with the new updated data refresh... there must be a way with in Power Query to successfully keep refreshed data with it overwriting?
Cheers
Dan
Solved! Go to Solution.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
No, there is not.
Power BI has no memory* . You need to manage your snapshots in the upstream system. * Yes, there is the self referencing option but that has no safety net.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi @1Dan_Crowther ,
@lbendlin is correct, Power Query is not a data warehouse and is not designed to retain data beyond its immediate use as standard. However, you could look into using Incremental Refresh, although this comes with its own significant caveats: https://learn.microsoft.com/en-us/power-bi/connect-data/incremental-refresh-overview
Pete
Now accepting Kudos! If my post helped you, why not give it a thumbs-up?
Proud to be a Datanaut!
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
No, there is not.
Power BI has no memory* . You need to manage your snapshots in the upstream system. * Yes, there is the self referencing option but that has no safety net.

Helpful resources
Subject | Author | Posted | |
---|---|---|---|
03-07-2024 07:49 PM | |||
02-07-2024 08:05 AM | |||
Anonymous
| 02-16-2021 12:05 AM | ||
02-20-2021 09:31 AM | |||
11-16-2023 10:55 AM |
User | Count |
---|---|
32 | |
18 | |
14 | |
11 | |
9 |