Forum Discussion

pmscorca's avatar
pmscorca
Icon for Post Prodigy rankPost Prodigy
1 year ago
Solved

Continuous arrival of duplicate events

Hi,

I've an Eventstream having an Azure Event Hubs as a source.

After some hours, I've noticed that in Eventstream arrive duplicate event data continuously, to write in a KQL table.

I'd like to understand if a such behaviour is due from Event Hubs or Eventstream and if it is possible to avoid to get these multiple duplicates.

Any suggests to me to solve a such issue, please? Many thanks

  • Hi,

    I've solved using the "Event processing before ingestion" option and not writing the EventProcessedUtcTime, PartitionId, EventEnqueuedUtcTime data into the KQL table.

    Well, it seems that Eventstream is responsible to produce multiple duplicates.

3 Replies

  • pmscorca's avatar
    pmscorca
    Icon for Post Prodigy rankPost Prodigy

    Hi,

    I've solved using the "Event processing before ingestion" option and not writing the EventProcessedUtcTime, PartitionId, EventEnqueuedUtcTime data into the KQL table.

    Well, it seems that Eventstream is responsible to produce multiple duplicates.

    • Anonymous's avatar
      Anonymous
      Not applicable

      Hi @pmscorca ,

      Glad to see you solved your problem yourself, please remember to mark your reply as solution so that more users can find solutions and learn faster. Thanks!

      Best Regards,
      Dino Tao

      • pmscorca's avatar
        pmscorca
        Icon for Post Prodigy rankPost Prodigy

        Hi, but because it seems that Eventstream is responsible to produce multiple duplicates. A such behaviour isn't good.

        Thanks