Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

July 7 - July 17 | Round 2 of the Power BI Dataviz World Championships. Don't miss your chance! Learn more

Reply
thelvyn78
Frequent Visitor

Creating a History table with a data flow

I have a JSON web query that pulls back a table of information.  (about 2400 rows).  This information does not have any date information in it.  I'm trying to keep a running history of what this data is daily.  I'm trying to do a refresh of the data once a day and add a date stamp to it when the query runs.  This works great but overwrites the data after each refresh, so it's not keeping the values from the previous days.  I've tried several workarounds where you use 2 tables and append the main table, which does not seem to work for me.  I think it may be because I'm using a calculated column for the date time stamp.  I have tried incremental refresh, but I get errors when I try to turn it on saying the query cannot be saved, with no other reason for the error.  I'm working in a premium workspace but from what I gather, incremental refresh works with pro accounts now also.  is this possible in Power BI?  

 

 
 
 
 
 
 
 
1 REPLY 1
lbendlin
Super User
Super User

No.  Use Power Automate to pull your JSON daily, slap the timestamp on, and save the data somewhere as a CSV file on a Onedrive or something. Then point Power BI to that OneDrive folder and consume the CSV files.

 

For a ore modern experience, ignore the CSV part and save the JSON as is - Power BI can read that just fine, and you can use the filedate as the timestamp.

 

You could even do incremental refresh but that's overkill with just 2400 rows per day.

Helpful resources

Announcements
FabCon and SQLCon Barcelona 2026

FabCon & SQLCon – Barcelona 2026

Join us in Barcelona for FabCon and SQLCon, the Fabric, Power BI, SQL, and AI community event. Save €200 with code FABCMTY200.

60 days of Data Days Carousel

Data Days 2026

Join Data Days 2026: 60 days of free live/on-demand sessions, challenges, study groups, and certification opportunities.

Power BI DataViz World Championships carousel

Power BI DataViz World Championships - June 2026

A new Power BI DataViz World Championship is coming this June! Don't miss out on submitting your entry.