Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

The Power BI Data Visualization World Championships is back! Get ahead of the game and start preparing now! Learn more

Reply
Anonymous
Not applicable

Incremental Refresh - only capture new data

I am working with a Reporting database that is refreshed 6 days a week (Sunday thru Friday at 10:00 pm) and skips holidays.  This database is loaded from a functional database that is updated 7 days a week.   

 

I created a dataflow with an incremental load to retain data for 2 years, refreshing the past 7 days.  I went with 7 days, thinking I needed at least 4 days to cover a long holiday weekend, plus a few days extra incase there was a delay in solving any issue.

 

The problem is that the query pulls data that never changes along with some data that unforunately can change any time.   So if data changes within the 7 day refresh period, the updates are reflected in Power BI.  The desire is that once a row is pulled into Power BI, it never change.  Basically we want the refresh to only add new rows and not replace existing rows.

 

Any suggestions on how to accomplish this?

2 REPLIES 2
GilbertQ
Super User
Super User

Hi @Anonymous 

 

You could look at using the detect data changes in your data to look at which columns to refresh

 

Incremental refresh for datasets and real-time data in Power BI - Power BI | Microsoft Learn

 

I would suggest if the data does not change, just let the query run and re-import those rows. It should not create any issues?





Did I answer your question? Mark my post as a solution!

Proud to be a Super User!







Power BI Blog

Anonymous
Not applicable

Thanks for the suggestions.  
I did not think 'Detect Data Changes' would help, because we don't want to apply any data changes, just add new rows.

And, unfortunately each row includes data that does not change, as well as data that can change.  And the request is to have none of the data on the rows change.

Helpful resources

Announcements
Power BI DataViz World Championships

Power BI Dataviz World Championships

The Power BI Data Visualization World Championships is back! Get ahead of the game and start preparing now!

December 2025 Power BI Update Carousel

Power BI Monthly Update - December 2025

Check out the December 2025 Power BI Holiday Recap!

FabCon Atlanta 2026 carousel

FabCon Atlanta 2026

Join us at FabCon Atlanta, March 16-20, for the ultimate Fabric, Power BI, AI and SQL community-led event. Save $200 with code FABCOMM.