Forum Discussion
petersmith
7 years agoNew Member
Dataflow incremental refresh with primary key
Hi All, Loving dataflows, but would love the ability to do an incremental refresh in more of an 'upsert' style. That is, maintain the uniqueness of a primary key within the dataset. Any ideas on ...
markive
6 years agoAdvocate II
The underlying technology for incremental refresh seems to be based on Partitions from SSAS. Therefore my guess is I don't think this will fundamentally change to support a primary key upsert any time soon.
Assuming therefore that when a record is updated it will appear in your incremental refresh therefore creating a duplicate you should add extra steps in your MCode to remove duplicates keeping the Max Primary Key therefore pruning the data in your Dataflows ETL process.
GilbertQ
6 years agoSuper User
Hi there
I do not think that this is something that will be happening anytime soon.
You could have an additional column which is the modified datetime which could be used to update?
I do not think that this is something that will be happening anytime soon.
You could have an additional column which is the modified datetime which could be used to update?
- eduardosoares966 years agoHelper I
This possibilite already able disponible to users Pro?