Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Calling all Data Engineers! Fabric Data Engineer (Exam DP-700) live sessions are back! Starting October 16th. Sign up.

Reply
thelvyn78
Frequent Visitor

Creating a History table with a data flow

I have a JSON web query that pulls back a table of information.  (about 2400 rows).  This information does not have any date information in it.  I'm trying to keep a running history of what this data is daily.  I'm trying to do a refresh of the data once a day and add a date stamp to it when the query runs.  This works great but overwrites the data after each refresh, so it's not keeping the values from the previous days.  I've tried several workarounds where you use 2 tables and append the main table, which does not seem to work for me.  I think it may be because I'm using a calculated column for the date time stamp.  I have tried incremental refresh, but I get errors when I try to turn it on saying the query cannot be saved, with no other reason for the error.  I'm working in a premium workspace but from what I gather, incremental refresh works with pro accounts now also.  is this possible in Power BI?  

 

 
 
 
 
 
 
 
1 REPLY 1
lbendlin
Super User
Super User

No.  Use Power Automate to pull your JSON daily, slap the timestamp on, and save the data somewhere as a CSV file on a Onedrive or something. Then point Power BI to that OneDrive folder and consume the CSV files.

 

For a ore modern experience, ignore the CSV part and save the JSON as is - Power BI can read that just fine, and you can use the filedate as the timestamp.

 

You could even do incremental refresh but that's overkill with just 2400 rows per day.

Helpful resources

Announcements
FabCon Global Hackathon Carousel

FabCon Global Hackathon

Join the Fabric FabCon Global Hackathon—running virtually through Nov 3. Open to all skill levels. $10,000 in prizes!

October Power BI Update Carousel

Power BI Monthly Update - October 2025

Check out the October 2025 Power BI update to learn about new features.

FabCon Atlanta 2026 carousel

FabCon Atlanta 2026

Join us at FabCon Atlanta, March 16-20, for the ultimate Fabric, Power BI, AI and SQL community-led event. Save $200 with code FABCOMM.

Top Solution Authors