March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount! Early bird discount ends December 31.
Register NowBe one of the first to start using Fabric Databases. View on-demand sessions with database experts and the Microsoft product team to learn just how easy it is to get started. Watch now
I've got a very large dataset with millions of rows. Within that dataset there are rows with specific combinations of data that are duplicitive. Specifically, a combination of 4 columns, which I need to report on, create duplicate rows. I need to identify these rows, which I have done, and then create another calculated column the displays an indicator (A "1" or "Yes" or anything) telling my which duplicate row has the highest value in another column, one not used in the 4 column combination.
Speficially, look at the attachement.
The column "Plan Duplicate (Concatenation)" contains the combination of the 4 columns in question. The column "Plan Duplicate (Duplicate Count)" shows the number of duplcate rows. What I want in the "Plan Duplicate (MAX Indicator) column is an indicator that populates only for the duplicate row with the highest "Enrolled Lives" value. So row 2 and 4 in the picture shold have a "1" and rows 1 and 3 should have a "0".
Keep in mind the dataset contains millions of rows and the duplicate count could be 2 or 20 or 200 so any hardcoding of duplicate counts is not possible. Also, this needs to function at the "Plan Duplicate(Concatenation)" level so any usage of MAX has to take that into account or else we'll be looking at the MAX of the entire million rows and getting erroneous values.
Here's what I've tried so far:
Still waiting for some help on this one.... anyone, anyone....
Hello community. Still really need help on this one....
@DJBAJG More details required. Read this post to get your answer quickly.
https://community.powerbi.com/t5/Community-Blog/How-to-Get-Your-Question-Answered-Quickly/ba-p/38490
Subscribe to the @PowerBIHowTo YT channel for an upcoming video on List and Record functions in Power Query!!
Learn Power BI and Fabric - subscribe to our YT channel - Click here: @PowerBIHowTo
If my solution proved useful, I'd be delighted to receive Kudos. When you put effort into asking a question, it's equally thoughtful to acknowledge and give Kudos to the individual who helped you solve the problem. It's a small gesture that shows appreciation and encouragement! ❤
Did I answer your question? Mark my post as a solution. Proud to be a Super User! Appreciate your Kudos 🙂
Feel free to email me with any of your BI needs.
March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount!
Arun Ulag shares exciting details about the Microsoft Fabric Conference 2025, which will be held in Las Vegas, NV.
User | Count |
---|---|
108 | |
73 | |
54 | |
52 | |
44 |
User | Count |
---|---|
161 | |
112 | |
67 | |
60 | |
50 |