Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Grow your Fabric skills and prepare for the DP-600 certification exam by completing the latest Microsoft Fabric challenge.

Reply
poli361
Helper I
Helper I

Incremental refresh and real-time data duplicate problem

Hi , 
I have a Sales Table that has last update date , which is used to configure the incremental and real time refresh as shown in the picture. 
The case is as follows: 
I have an invoice ,which was loaded during the incremental load period .
When this invoice is altered in the Real-time period , I end up have a duplicate value for this invoice. 
The Service seems to keep both . I understand there are different partitions in Sales table , but is there any way we could avoid or mitigate the duplication?

poli361_0-1711546013643.png
Thanks a lot in advance

 

2 REPLIES 2
lbendlin
Super User
Super User

 I understand there are different partitions in Sales table , but is there any way we could avoid or mitigate the duplication?

It is your responsibility to refresh the partition that now contains the duplicate, to remove the conflict.

 

There is no way to selectively delete or alter rows in a partition. You need to re-process the entire partition.

I actually couldn't find a solution to my problem , so I have to reconsider my approach . 
Thank you so much for your help.

Helpful resources

Announcements
RTI Forums Carousel3

New forum boards available in Real-Time Intelligence.

Ask questions in Eventhouse and KQL, Eventstream, and Reflex.

MayPowerBICarousel1

Power BI Monthly Update - May 2024

Check out the May 2024 Power BI update to learn about new features.

Europe Fabric Conference

Europe’s largest Microsoft Fabric Community Conference

Join the community in Stockholm for expert Microsoft Fabric learning including a very exciting keynote from Arun Ulag, Corporate Vice President, Azure Data.

Top Solution Authors
Top Kudoed Authors