Forum Discussion

frano72's avatar
frano72
Icon for Helper IV rankHelper IV
6 years ago

Dataflow refresh : "An entry with the same key already exists"

Hi, I have a dataflow that references a linked entity and performs some minor transformations.   I am sporadically getting refresh issues with it.  The error is :   Error: An entry with the same ...
dataflow
Samurize24's avatar
Samurize24
Frequent Visitor
5 years ago

Hi,

Same issue, with schudele refresh the same error is produced, but when i manuely refresh is works fine.
Any update how to workaround this would be helpfull. 

 

  • frano72's avatar
    frano72
    Icon for Helper IV rankHelper IV
    5 years ago

    Hey Samurize24 - I never really got to the bottom of it at that time and I was then consumed by another issue...WHICH may have solved the original one.

     

    Have a go at playing around with the enhanced compute engine settings on your dataflow.  What is working for me is having my ingestion dataflows set to optimised.  On my transformation ones i have them set to disabled.  The "key already exists" sounds a lot like a sql type issue doesn't it....and enhanced compute engine has a sql cache behind the scenes.  (I'm still a bit confused on these matters, i've seen the screenshare from microsoft that says one thing (turn them on in transformation) and the matt roche blog seems to suggest not required for transformation - so am going with what i found actually works in practice).

     

    see how you go !