Data Query - Tracking Data Over Time

[andyL]

Hi,

Here is my question hopefully at its simpliest level.

I have a automated process that takes pleace that imports a HTML file into Power BI on a regular basis throughout the day. This gives us a snap shot in time of key performance indicators.

What I want to to do now is build upon that and keep track of the data over time. At the simplest level I want to be able to append the current data set once it has been imported with a date and time field showing the time the file was run into the system and then use the appended data in another PowerBI report to track progress over time.

I have read a few articles but wondering if anyone has any advice on the best way to approach it?

Thanks

[Sahir_Maharaj · Accepted solution]

Hello @andyL,

Here's a few approaches to this:

1. Since you're importing HTML files regularly, you could use Power Query to add a datetime column each time you load the data. This approach works for the current load but doesn't accumulate historical data over time within Power BI. You can manually append new data to the old one if you load it all at once (but this is more of a static solution)

2. If you're looking for automation within the Microsoft ecosystem, Power Automate can be used to schedule and automate the process of appending data and timestamps to a central store like SharePoint lists, SQL databases, or even Excel files stored in OneDrive or SharePoint

3. For a more automated process, I recommend an external database or data lake approach with an automated script or tool to append data over time.

Hope this helps!