Forum Discussion

mclawler's avatar
mclawler
Helper III
1 year ago
Solved

How to exclude duplicate values

Hi there, I am trying to remove duplicate transactions and keep a certain type.  

I need the Customer Count to equal 22 and the Amount Sum to equal $110,500

 

The logic should be:

If the same "Customer Number" appears > 1 time then it needs to only Count the Customer Number with the Product "Personal Line"  &&

If the same "Customer Number" appears > 1 time then it needs to only Sum the Amount with the Product "Personal Line"

 

It almost needs a temp table with the duplicate data stripped out of it?  Because ultimately it then becomes separated into groups for a matrix table(the image below isn't accurate):

 

Here is the table data.  Basically keep the green and strip out the red because of the duplicate Customer Number:

 

Thank you! 

12 Replies

  • Hi,

    Why should the answer be 110,500?  Share data in a format that can be pasted in an MS Excel file.

    • mclawler's avatar
      mclawler
      Helper III

      Because the 2 I need removed are technically duplicates.  Which would leave 22 units for $110,500 as the correct Totals.  Thank you for your help!

       

      Member NumberProductAmount BookedFundedDatePCL Increase/PCL New
      1110410PERSONAL CREDIT LINE$9,500.0029-Jul-24New PCL
      1239460PERSONAL CREDIT LINE$10,000.0022-Jul-24New PCL
      1472450Personal Line$5,000.0010-Jul-24Existing PCL Increase
      1596150PERSONAL CREDIT LINE$14,000.0011-Jul-24New PCL
      2316130PERSONAL CREDIT LINE$7,000.0011-Jul-24New PCL
      2588730Personal Line$1,500.006-Jul-24Existing PCL Increase
      2588730PERSONAL CREDIT LINE$1,500.006-Jul-24New PCL
      3215470PERSONAL CREDIT LINE$4,500.0031-Jul-24New PCL
      3574660PERSONAL CREDIT LINE$5,000.0024-Jul-24New PCL
      3697240PERSONAL CREDIT LINE$4,000.0030-Jul-24New PCL
      4338890PERSONAL CREDIT LINE$5,000.001-Jul-24New PCL
      4562300PERSONAL CREDIT LINE$5,000.0024-Jul-24New PCL
      5563620Personal Line$500.0030-Jul-24Existing PCL Increase
      5563620PERSONAL CREDIT LINE$500.0030-Jul-24New PCL
      5648730PERSONAL CREDIT LINE$10,000.0023-Jul-24New PCL
      6546300PERSONAL CREDIT LINE$1,000.0018-Jul-24New PCL
      7412220PERSONAL CREDIT LINE$10,000.0029-Jul-24New PCL
      7536160PERSONAL CREDIT LINE$2,500.002-Jul-24New PCL
      7898990PERSONAL CREDIT LINE$2,000.0024-Jul-24New PCL
      8523290Personal Line$1,000.0017-Jul-24Existing PCL Increase
      8979840PERSONAL CREDIT LINE$500.0030-Jul-24New PCL
      9514250Personal Line$2,000.0010-Jul-24Existing PCL Increase
      9632420PERSONAL CREDIT LINE$10,000.0031-Jul-24New PCL
      9873000PERSONAL CREDIT LINE$500.0024-Jul-24New PCL
    • mclawler's avatar
      mclawler
      Helper III

      H! I have created 2 measures that get me the correct grand totals, but the row items are still incorrect.

       

       

      The Existing PCL Increase is correct = 5 units for $10,000

      The New PCL is incorrect, should = 17 units for $102,500

       

      I have created a pbix for testing here : PCL Testing.pbix

       

      If the SAME Member Number appears for both Existing and New, I need the measure to strip out the data rows pertaining to the New PCL redundant Member Number.  This visual might make it clearer.  Include all black and green(duplicate member number), exclude the red:


      Member NumberProductAmount BookedFundedDatePCL Increase/PCL New
      1110410PERSONAL CREDIT LINE$9,500.0029-Jul-24New PCL
      1239460PERSONAL CREDIT LINE$10,000.0022-Jul-24New PCL
      1472450Personal Line$5,000.0010-Jul-24Existing PCL Increase
      1596150PERSONAL CREDIT LINE$14,000.0011-Jul-24New PCL
      2316130PERSONAL CREDIT LINE$7,000.0011-Jul-24New PCL
      2588730Personal Line$1,500.006-Jul-24Existing PCL Increase
      2588730PERSONAL CREDIT LINE$1,500.006-Jul-24New PCL
      3215470PERSONAL CREDIT LINE$4,500.0031-Jul-24New PCL
      3574660PERSONAL CREDIT LINE$5,000.0024-Jul-24New PCL
      3697240PERSONAL CREDIT LINE$4,000.0030-Jul-24New PCL
      4338890PERSONAL CREDIT LINE$5,000.001-Jul-24New PCL
      4562300PERSONAL CREDIT LINE$5,000.0024-Jul-24New PCL
      5563620Personal Line$500.0030-Jul-24Existing PCL Increase
      5563620PERSONAL CREDIT LINE$500.0030-Jul-24New PCL
      5648730PERSONAL CREDIT LINE$10,000.0023-Jul-24New PCL
      6546300PERSONAL CREDIT LINE$1,000.0018-Jul-24New PCL
      7412220PERSONAL CREDIT LINE$10,000.0029-Jul-24New PCL
      7536160PERSONAL CREDIT LINE$2,500.002-Jul-24New PCL
      7898990PERSONAL CREDIT LINE$2,000.0024-Jul-24New PCL
      8523290Personal Line$1,000.0017-Jul-24Existing PCL Increase
      8979840PERSONAL CREDIT LINE$500.0030-Jul-24New PCL
      9514250Personal Line$2,000.0010-Jul-24Existing PCL Increase
      9632420PERSONAL CREDIT LINE$10,000.0031-Jul-24New PCL
      9873000PERSONAL CREDIT LINE$500.0024-Jul-24New PCL
  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi ALL,
    Firstly, Ashish_Mathur Thank you for your solution!
    And mclawler  ,you can use measure to write down the requirements you need to implement, and then aggregate them into a new table using summarize. 

    CALCULATE(SUM(PCL_Data[Amount]),ALLEXCEPT(PCL_Data,'PCL_Data'[Customer Number])) 

     

    We can use the rankx function to determine the first of the duplicate values as the return value,Fistly product As long as it is similar to Fistly pcl, you can change a few parameters.

    FirstPCLMeasure = 
    IF(
       CALCULATE(COUNTROWS('PCL_Data'), ALLEXCEPT('PCL_Data', 'PCL_Data'[Customer Number])) > 1,
       CALCULATE(
           MAX('PCL_Data'[PCL Increase/PCL New]),
           FILTER(
               'PCL_Data',
               'PCL_Data'[Customer Number] = MAX('PCL_Data'[Customer Number]) &&
               RANKX(
                   FILTER('PCL_Data', 'PCL_Data'[Customer Number] = MAX('PCL_Data'[Customer Number])),
                   'PCL_Data'[PCL Increase/PCL New],
                   ,
                   ASC
               ) = 1
           )
       ),
      MAX('PCL_Data'[PCL Increase/PCL New])
    )

    Finally in the aggregation by summarize to form a new table, the design of their own matrix

     

    Table = 
    SUMMARIZE('PCL_Data','PCL_Data'[Customer Number],"Amount",'PCL_Data'[measure],"A",'PCL_Data'[FirstPCLMeasure],"B",'PCL_Data'[FirstProductMeasure])

    If you still have questions, check out my pbix file, I hope it helps!

     

     

    Hope it helps!

     

    Best regards,
    Community Support Team_ Tom Shen

     

    If this post helps then please consider Accept it as the solution to help the other members find it more quickly.

     

     

    • mclawler's avatar
      mclawler
      Helper III

      H! Those measures aren't working for what I'm trying to accomplish.  I have created 2 measures that get me the correct grand totals, but the row items are still incorrect.

       

       

      The Existing PCL Increase is correct = 5 units for $10,000

      The New PCL is incorrect, should = 17 units for $102,500

       

      I have created a pbix for testing here : PCL Testing.pbix

       

      If the SAME Member Number appears for both Existing and New, I need the measure to strip out the data rows pertaining to the New PCL redundant Member Number.  This visual might make it clearer.  Include all black and green(duplicate member number), exclude the red:


      Member NumberProductAmount BookedFundedDatePCL Increase/PCL New
      1110410PERSONAL CREDIT LINE$9,500.0029-Jul-24New PCL
      1239460PERSONAL CREDIT LINE$10,000.0022-Jul-24New PCL
      1472450Personal Line$5,000.0010-Jul-24Existing PCL Increase
      1596150PERSONAL CREDIT LINE$14,000.0011-Jul-24New PCL
      2316130PERSONAL CREDIT LINE$7,000.0011-Jul-24New PCL
      2588730Personal Line$1,500.006-Jul-24Existing PCL Increase
      2588730PERSONAL CREDIT LINE$1,500.006-Jul-24New PCL
      3215470PERSONAL CREDIT LINE$4,500.0031-Jul-24New PCL
      3574660PERSONAL CREDIT LINE$5,000.0024-Jul-24New PCL
      3697240PERSONAL CREDIT LINE$4,000.0030-Jul-24New PCL
      4338890PERSONAL CREDIT LINE$5,000.001-Jul-24New PCL
      4562300PERSONAL CREDIT LINE$5,000.0024-Jul-24New PCL
      5563620Personal Line$500.0030-Jul-24Existing PCL Increase
      5563620PERSONAL CREDIT LINE$500.0030-Jul-24New PCL
      5648730PERSONAL CREDIT LINE$10,000.0023-Jul-24New PCL
      6546300PERSONAL CREDIT LINE$1,000.0018-Jul-24New PCL
      7412220PERSONAL CREDIT LINE$10,000.0029-Jul-24New PCL
      7536160PERSONAL CREDIT LINE$2,500.002-Jul-24New PCL
      7898990PERSONAL CREDIT LINE$2,000.0024-Jul-24New PCL
      8523290Personal Line$1,000.0017-Jul-24Existing PCL Increase
      8979840PERSONAL CREDIT LINE$500.0030-Jul-24New PCL
      9514250Personal Line$2,000.0010-Jul-24Existing PCL Increase
      9632420PERSONAL CREDIT LINE$10,000.0031-Jul-24New PCL
      9873000PERSONAL CREDIT LINE$500.0024-Jul-24New PCL