Join us for an expert-led overview of the tools and concepts you'll need to pass exam PL-300. The first session starts on June 11th. See you there!
Get registeredPower BI is turning 10! Let’s celebrate together with dataviz contests, interactive sessions, and giveaways. Register now.
Hello, I would like to know that i have deployed one report on service and set powerautomate data refresh flow for every 5 min and set manual refresh as well for 2 times in a day. Now the issue is i applied remove duplicates steps in power bi desktop but after some time in service its showing data refresh fail due to duplicates, but when i refresh the report on desktop and redeploy it to service then there is no duplicate is showing. My reports are having incremental refresh as well.
Please help me out what should I do or do i need to change anything.
Hi @Prachi_Ramteke ,
Thanks for reaching out to the Microsoft fabric community forum.
Please go through the below document and solved issue which may help you in resolving the issue:
https://learn.microsoft.com/en-us/power-bi/connect-data/incremental-refresh-troubleshoot
Solved: Re: Incremental refresh is duplicating the records - Microsoft Fabric Community
If this post was helpful, please give us Kudos and consider marking Accept as solution to assist other members in finding it more easily.
Best Regards,
Menaka.
Community Support Team.
Hi @Prachi_Ramteke ,
May I ask if you have resolved this issue? If so, please mark the helpful reply and accept it as the solution. This will be helpful for other community members who have similar problems to solve it faster.
Thank you.
Hi @Prachi_Ramteke It might be because of discrepancies in handling duplicates between Power BI Desktop and the Service. Ensure your duplicate removal logic accounts for all data variations in incremental refresh settings. Check the data source updates for new records violating uniqueness constraints. Adjust incremental refresh policies to include duplicate checks or reprocess full data as a one-time fix. Validate steps using a staging table or intermediate query to ensure consistency.
User | Count |
---|---|
47 | |
30 | |
27 | |
26 | |
26 |
User | Count |
---|---|
60 | |
56 | |
36 | |
32 | |
28 |