Refresh issue

[Prachi_Ramteke]

Hello, I would like to know that i have deployed one report on service and set powerautomate data refresh flow for every 5 min and set manual refresh as well for 2 times in a day. Now the issue is i applied remove duplicates steps in power bi desktop but after some time in service its showing data refresh fail due to duplicates, but when i refresh the report on desktop and redeploy it to service then there is no duplicate is showing. My reports are having incremental refresh as well. 

Please help me out what should I do or do i need to change anything.

[Akash_Varuna · Accepted solution]

Hi @Prachi_Ramteke It might be because of discrepancies in handling duplicates between Power BI Desktop and the Service. Ensure your duplicate removal logic accounts for all data variations in incremental refresh settings. Check the data source updates for new records violating uniqueness constraints. Adjust incremental refresh policies to include duplicate checks or reprocess full data as a one-time fix. Validate steps using a staging table or intermediate query to ensure consistency.

[v-menakakota · Accepted solution]

Hi  @Prachi_Ramteke  ,
Thanks for reaching out to the Microsoft fabric community forum. 

Please go through the below document and solved issue which may help you in resolving the issue:
https://learn.microsoft.com/en-us/power-bi/connect-data/incremental-refresh-troubleshoot

Solved: Re: Incremental refresh is duplicating the records - Microsoft Fabric Community

If this post was helpful, please give us Kudos and consider marking Accept as solution to assist other members in finding it more easily.
Best Regards, 
Menaka.
Community Support Team.

[v-menakakota]

Hi  @Prachi_Ramteke ,

May I ask if you have resolved this issue? If so, please mark the helpful reply and accept it as the solution. This will be helpful for other community members who have similar problems to solve it faster. 

Thank you. 

[v-menakakota]

Hi  @Prachi_Ramteke ,

I wanted to check if you had the opportunity to review the information provided. Please feel free to contact us if you have any further questions. If my response has addressed your query, please accept it as a solution so that other community members can find it easily. 

 
Thank you.

[v-menakakota]

Hi @Prachi_Ramteke ,

May I ask if you have resolved this issue? If so, please mark the helpful reply and accept it as the solution. This will be helpful for other community members who have similar problems to solve it faster. 

Thank you. 

[Akash_Varuna · Accepted solution]

Hi @Prachi_Ramteke It might be because of discrepancies in handling duplicates between Power BI Desktop and the Service. Ensure your duplicate removal logic accounts for all data variations in incremental refresh settings. Check the data source updates for new records violating uniqueness constraints. Adjust incremental refresh policies to include duplicate checks or reprocess full data as a one-time fix. Validate steps using a staging table or intermediate query to ensure consistency.