Forum Discussion

CPIBecklon's avatar
CPIBecklon
Icon for Helper I rankHelper I
4 years ago
Solved

Removing most recent dates of duplicate rows.

Hello!

 

I have a query that looks as follows:

 

Lab NameDate/TimeSIDTestAction
EfficientLabs1/22/2018 2:18:16 AMA123K+Order Received
EfficientLabs1/22/2018 4:27:32 AMA124TnIOrder Received
EfficientLabs1/22/2018 5:14:28 AMA124TnIOrder Received
EfficientLabs1/22/2018 5:14:28 AMA123K+Order Received

 

I want to keep the ealiest record of each test. I have clicked onto all fields except date/time and removed duplicate rows, but when I do, the later records of each test are the ones to remain. I have tried sorting in various ways, but nothing seems to work. I would greatly appreciate help on manipulating this table. Also, I need for this manipulation to occur in Power Query as I intend to append the final table to other tables. Thank you in advance!

  • See the working here - Open a blank query - Home - Advanced Editor - Remove everything from there and paste the below code to test (later on when you use the query on your dataset, you will have to change the source appropriately. If you have columns other than these, then delete Changed type step and do a Changed type for complete table from UI again)

     

    let
        Source = Table.FromRows(Json.Document(Binary.Decompress(Binary.FromText("i45Wck1Ly0zOTM0r8UlMKlbSUTLUNzLSNzIwtFAwsjK0AAo4GhoZAylvbSDhX5SSWqQQlJqcmlmWmqIUq4NPv4mVkTlEvwmQCsnzJNUAUytDEyoZgNMHsQA=", BinaryEncoding.Base64), Compression.Deflate)), let _t = ((type nullable text) meta [Serialized.Text = true]) in type table [#"Lab Name" = _t, #"Date/Time" = _t, SID = _t, Test = _t, Action = _t]),
        #"Changed Type" = Table.TransformColumnTypes(Source,{{"Lab Name", type text}, {"Date/Time", type datetime}, {"SID", type text}, {"Test", type text}, {"Action", type text}}),
        #"Grouped Rows" = Table.Group(#"Changed Type", {"Lab Name", "SID", "Test", "Action"}, {{"Date/Time", each List.Min([#"Date/Time"]), type nullable datetime}}),
        #"Reordered Columns" = Table.ReorderColumns(#"Grouped Rows",{"Lab Name", "Date/Time", "SID", "Test", "Action"})
    in
        #"Reordered Columns"

     

    👍 It's been a pleasure to help you | Help Hours: 11 AM to 9 PM (UTC+05:30)

    How to get your questions answered quickly -- How to provide sample data

  • Vijay_A_Verma  Thank you so much! I studied your example and now clearly understand what I was doing wrong! Thank you! Thank you! Thank you!

2 Replies

  • Vijay_A_Verma's avatar
    Vijay_A_Verma
    Icon for Most Valuable Professional rankMost Valuable Professional

    See the working here - Open a blank query - Home - Advanced Editor - Remove everything from there and paste the below code to test (later on when you use the query on your dataset, you will have to change the source appropriately. If you have columns other than these, then delete Changed type step and do a Changed type for complete table from UI again)

     

    let
        Source = Table.FromRows(Json.Document(Binary.Decompress(Binary.FromText("i45Wck1Ly0zOTM0r8UlMKlbSUTLUNzLSNzIwtFAwsjK0AAo4GhoZAylvbSDhX5SSWqQQlJqcmlmWmqIUq4NPv4mVkTlEvwmQCsnzJNUAUytDEyoZgNMHsQA=", BinaryEncoding.Base64), Compression.Deflate)), let _t = ((type nullable text) meta [Serialized.Text = true]) in type table [#"Lab Name" = _t, #"Date/Time" = _t, SID = _t, Test = _t, Action = _t]),
        #"Changed Type" = Table.TransformColumnTypes(Source,{{"Lab Name", type text}, {"Date/Time", type datetime}, {"SID", type text}, {"Test", type text}, {"Action", type text}}),
        #"Grouped Rows" = Table.Group(#"Changed Type", {"Lab Name", "SID", "Test", "Action"}, {{"Date/Time", each List.Min([#"Date/Time"]), type nullable datetime}}),
        #"Reordered Columns" = Table.ReorderColumns(#"Grouped Rows",{"Lab Name", "Date/Time", "SID", "Test", "Action"})
    in
        #"Reordered Columns"

     

    👍 It's been a pleasure to help you | Help Hours: 11 AM to 9 PM (UTC+05:30)

    How to get your questions answered quickly -- How to provide sample data

  • Vijay_A_Verma  Thank you so much! I studied your example and now clearly understand what I was doing wrong! Thank you! Thank you! Thank you!