Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Calling all Data Engineers! Fabric Data Engineer (Exam DP-700) live sessions are back! Starting October 16th. Sign up.

Reply
poli361
Helper I
Helper I

Incremental refresh and real-time data duplicate problem

Hi , 
I have a Sales Table that has last update date , which is used to configure the incremental and real time refresh as shown in the picture. 
The case is as follows: 
I have an invoice ,which was loaded during the incremental load period .
When this invoice is altered in the Real-time period , I end up have a duplicate value for this invoice. 
The Service seems to keep both . I understand there are different partitions in Sales table , but is there any way we could avoid or mitigate the duplication?

poli361_0-1711546013643.png
Thanks a lot in advance

 

2 REPLIES 2
lbendlin
Super User
Super User

 I understand there are different partitions in Sales table , but is there any way we could avoid or mitigate the duplication?

It is your responsibility to refresh the partition that now contains the duplicate, to remove the conflict.

 

There is no way to selectively delete or alter rows in a partition. You need to re-process the entire partition.

I actually couldn't find a solution to my problem , so I have to reconsider my approach . 
Thank you so much for your help.

Helpful resources

Announcements
FabCon Global Hackathon Carousel

FabCon Global Hackathon

Join the Fabric FabCon Global Hackathon—running virtually through Nov 3. Open to all skill levels. $10,000 in prizes!

October Power BI Update Carousel

Power BI Monthly Update - October 2025

Check out the October 2025 Power BI update to learn about new features.

FabCon Atlanta 2026 carousel

FabCon Atlanta 2026

Join us at FabCon Atlanta, March 16-20, for the ultimate Fabric, Power BI, AI and SQL community-led event. Save $200 with code FABCOMM.

Top Kudoed Authors