Forum Discussion
Dataflow incremental refresh with primary key
I assume the meaning of the question is similar to my own..
I can use a Date field in my data to sync only the last day for example. But my 'Upsert' question is will it be able to replace existing data if the primary key shows it already exists?
Lets say I have 10 records, one record created each day. If a user of my system updates record 2 that was originally created 2 says ago but updated today, will the incremental refresh 'Upsert' it? Or will this break the refresh?
When I read about partitions and how incremental refresh seemed to work in original Analysis Services it seems to be purely additive for new data incrementally.
Hi there
That would work as either by making the incremental refresh look at the DateTime column of the updated data.
Or you could look at the following below when setting it up
Hi there
What you can do is to also enable the option for Detect Changes, where you can update the column based on a date, which will be included in the incremental process
Hi GilbertQ Thanks. But this does not take care of my scenario. If only depends on Max date in "Changes detected". If my date column is not falling in the rangeof teh incremental refresh cycle , it will still miss the older rows.
Let me know if I missed something
