Forum Discussion
Best Approach for Incremental Refresh When Historical Records Can Be Updated
Hi MattiaFratello Thank you so much for responding. My doubt is Detect data changes can update archived records as well ? My understanding is, it can only make changes in the incremetal refresh partition not in archvied one. My primary motive is to reduce the compute cost at DB level when refreshing the report.
fFor second option we can create a staging table with only updated records but how we can merger them with 7years of data imported in Power BI ?
Hey Mayankb024, sorry got pretty busy today
I would try to set the incremental refresh for the full 7 years (every time you refresh 7 years) with 1 day partition and Detect Data Changes active.
Like this you would not lose any modified data but you will refresh only small partitions?
I would give it a try and see if it works before going into the staging table which will require more effort.
Hi MattiaFratello So you are sayinh we will set archive data as one day and keep 7 years as incremental refresh with detect data changes. Let me try this approch. Thank you
Mayankb024 Let me now if it works. If not, I can try to think about the DB solution but maybe during the weekend.