Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Be one of the first to start using Fabric Databases. View on-demand sessions with database experts and the Microsoft product team to learn just how easy it is to get started. Watch now

Reply
Anonymous
Not applicable

PowerBi Dataflow duplicate some row when imported in a report

Hello,
I have come across something that I haven't managed to understand while working with dataflows. In one of my tables (after importing the dataflow in a powerbi report), some rows where duplicated (some doubled, some tripled) while the majority of them were correct, but when I went back to the table editor of the dataflow, no duplicate showed up. Because I thought the discrepancy was explained by the fact that while editing the dataflow you're only working on a preview, I reduced the dataflow to a single row as seen here :
table in dataflow.PNG


 But when I imported this table in a power BI report, I received two identical rows as seen here : 

table in power query.PNG

 

As anyone encountered something similar and know the explanation/solution to this problem ? 

Thank you in advance,

Valentin

5 REPLIES 5
crocus1
Frequent Visitor

Hi,

I had this problem and had to take off the Incremental Refresh on the Power BI Service dataflow to remove the duplicates.

 

Daryl-Lynch-Bzy
Resident Rockstar
Resident Rockstar

Hi @Anonymous - is it possible that the Join step (#"Requetes fusionnes 1") is creating the duplicate when expanded in the following step.  If you moved your Filter in the final step (#"Lignes filtrees") before the join step, does the duplication appear now?  If it does, this sugggests join join is Many to Many, not Many to One.  Therefore you will need to remove the duplicate from the table on the Right Side of the join.

v-yanjiang-msft
Community Support
Community Support

Hi @Anonymous ,

Please try the workaroud in this thread:


Make sure your target table has a Key set up that uniquely identifies each row (maybe just the name? or a composite of name and type?) Dataflow will pick up on the key on the table and for all the rows to be imported it will use the key to upsert instead of just inserting.


Best Regards,
Community Support Team _ kalyj

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.



Anonymous
Not applicable

Hello,
I've tried adding a key using the Table.AddKey function (and while specifying that it is a primary key) on my single-row table, but I still get a duplicate when I import it.
Best Regards,
Valentin 

AnkitKukreja
Super User
Super User

Hi! @Anonymous 

 

I would recommend you try to repro this with another Dataflow(DF). If the other DF is also giving you the same result then try changing the source. If that also doesn't help, then please raise a ticket to MS. 

 

For Power BI trainings or support dm or reach out to me on LinkedIn.
If my response has successfully addressed your question or concern, I kindly request that you mark this post as resolved. Additionally, if you found my assistance helpful, a thumbs-up would be greatly appreciated.

Thanks,
Ankit Kukreja
www.linkedin.com/in/ankit-kukreja1904
https://topmate.io/ankit_kukreja

Helpful resources

Announcements
Las Vegas 2025

Join us at the Microsoft Fabric Community Conference

March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount!

ArunFabCon

Microsoft Fabric Community Conference 2025

Arun Ulag shares exciting details about the Microsoft Fabric Conference 2025, which will be held in Las Vegas, NV.

December 2024

A Year in Review - December 2024

Find out what content was popular in the Fabric community during 2024.

Top Solution Authors