Forum Discussion

bocajpedersen's avatar
bocajpedersen
New Member
2 years ago
Solved

Calculate time between time-stamp entries based on row conditions

I have a table of swipe entries to a site. On occasions, people can swipe in and out multiple times a day. 

 

I want to understand the the time off-site by calculating the difference between the swipe-out events and the following swipe-in events for the same day and same user ID. 

 

Table ishown below. I am trying to make a calculated columnD. 3 examples provided of the calc I am trying to do in different colours. 

 

 

 

 

  • bocajpedersen 

    Create a blank Query, go to the Advanced Editor, clear the existing code, and paste the codes give below and follow the steps.

    let
        Source = Table.FromRows(Json.Document(Binary.Decompress(Binary.FromText("fZXLbhsxDEV/xfA6RiVK1INrb7xKgXZnBEVReNFF06J1/j+XMylGpJIBZmEf32tx+NL1evx8+/vv9/Phcj4+HM/f77dPX3/+uh0uz+br48v9+PRwPV7O3yrVjt9CPX25/TlRoHQoErowO9ols4Sy44tBAh5vjCQhSwrOGbOVBOHkcRUOkqN38hhrzBKbo11SEppONIpc8TiKODJJoh1jTMtLRo+bhCqheWcxoZLE5CiSxjg17xhjVCdFjxsYErQ58RkSU8mcJTdHuyCxVP2JRkFNFZYiCI6atI+NyA5iCuRxV2fq3tk2CatxDXWgTRJC3fN1bS6kz1KtUhGeQn1P4jBeHNFOheybBHVOb6F2U0hCfcmXw0oyHvY4a7rH7MxOjB5qnT1GDxdJfkAojC3AVcfWUhzX5gEZFWiBIDE6qvXFUE4FSafHH/dtC2Dci8e0dGvac2L0eF08BqOL0RqTM28SdcHr6Fspi88rb5KieYjsKAYukUnrZISEF4nDTUsZm3eW8cj/S3Kk+D/kO03DbCUIlidn1WDjVJK6SVDtorvJUl1Z/M44tzFW9Oa6lgfa1Ue840PzFKHsqG7qoBvwYyMkKa7tajDSiimfstPHFkCtQ58ochPSrm9VWKqbOpgduRipjO/I6J7sqDZrmpcyVdcA3B3VJY/qTqNsJbjWll1ncNWtQv5mpuaOzMXR9f8o+1ibb/Pl0jJYl/JyTz69Ag==", BinaryEncoding.Base64), Compression.Deflate)), let _t = ((type nullable text) meta [Serialized.Text = true]) in type table [#"(blank)" = _t, #"(blank).1" = _t, #"(blank).2" = _t]),
        #"Promoted Headers" = Table.PromoteHeaders(Source, [PromoteAllScalars=true]),
        #"Changed Type" = Table.TransformColumnTypes(#"Promoted Headers",{{"Person ID", type text}, {"Date/Time In", type datetime}, {"Date/Time Out", type datetime}}),
        #"Sorted Rows" = Table.Sort(#"Changed Type",{{"Person ID", Order.Descending}, {"Date/Time In", Order.Ascending}, {"Date/Time Out", Order.Ascending}}),
        #"Added Index" = Table.AddIndexColumn(#"Sorted Rows", "Index", -1, 1, Int64.Type),
        #"Added Custom" = 
        Table.AddColumn(
            #"Added Index", "Custom", each 
        if [Index] >= 0 then    
            let
                __id = #"Added Index"{[Index]}[Person ID],
                __pDate = #"Added Index"{[Index]}[#"Date/Time Out"],
                __cdate = [#"Date/Time In"]
            in
                if __id = [Person ID] and 
                     Date.From(__pDate) =  Date.From(__cdate)                     
                then
                     Duration.From(__cdate-__pDate)
                else 
                    null else null, type duration
        ) 
    in
        #"Added Custom"

     



4 Replies

  • adudani's avatar
    adudani
    Memorable Member

    Hi bocajpedersen ,

    Here's my approach 

    1. Add a column subtracting Out - In , as duration.

    2. Add a column extracting either date ( assuming both are always the same)

    3. Group by person Id and date, aggregation is sum of the duration. ( This should be on site time)

    4. Could negate 24 hours from this to get offsite time

     

    If this doesn't resolve the issue , Kindly post the raw data in a table/ readable query format with any other considerations while masking sensitive data.

  • bocajpedersen 

    Create a blank Query, go to the Advanced Editor, clear the existing code, and paste the codes give below and follow the steps.

    let
        Source = Table.FromRows(Json.Document(Binary.Decompress(Binary.FromText("fZXLbhsxDEV/xfA6RiVK1INrb7xKgXZnBEVReNFF06J1/j+XMylGpJIBZmEf32tx+NL1evx8+/vv9/Phcj4+HM/f77dPX3/+uh0uz+br48v9+PRwPV7O3yrVjt9CPX25/TlRoHQoErowO9ols4Sy44tBAh5vjCQhSwrOGbOVBOHkcRUOkqN38hhrzBKbo11SEppONIpc8TiKODJJoh1jTMtLRo+bhCqheWcxoZLE5CiSxjg17xhjVCdFjxsYErQ58RkSU8mcJTdHuyCxVP2JRkFNFZYiCI6atI+NyA5iCuRxV2fq3tk2CatxDXWgTRJC3fN1bS6kz1KtUhGeQn1P4jBeHNFOheybBHVOb6F2U0hCfcmXw0oyHvY4a7rH7MxOjB5qnT1GDxdJfkAojC3AVcfWUhzX5gEZFWiBIDE6qvXFUE4FSafHH/dtC2Dci8e0dGvac2L0eF08BqOL0RqTM28SdcHr6Fspi88rb5KieYjsKAYukUnrZISEF4nDTUsZm3eW8cj/S3Kk+D/kO03DbCUIlidn1WDjVJK6SVDtorvJUl1Z/M44tzFW9Oa6lgfa1Ue840PzFKHsqG7qoBvwYyMkKa7tajDSiimfstPHFkCtQ58ochPSrm9VWKqbOpgduRipjO/I6J7sqDZrmpcyVdcA3B3VJY/qTqNsJbjWll1ncNWtQv5mpuaOzMXR9f8o+1ibb/Pl0jJYl/JyTz69Ag==", BinaryEncoding.Base64), Compression.Deflate)), let _t = ((type nullable text) meta [Serialized.Text = true]) in type table [#"(blank)" = _t, #"(blank).1" = _t, #"(blank).2" = _t]),
        #"Promoted Headers" = Table.PromoteHeaders(Source, [PromoteAllScalars=true]),
        #"Changed Type" = Table.TransformColumnTypes(#"Promoted Headers",{{"Person ID", type text}, {"Date/Time In", type datetime}, {"Date/Time Out", type datetime}}),
        #"Sorted Rows" = Table.Sort(#"Changed Type",{{"Person ID", Order.Descending}, {"Date/Time In", Order.Ascending}, {"Date/Time Out", Order.Ascending}}),
        #"Added Index" = Table.AddIndexColumn(#"Sorted Rows", "Index", -1, 1, Int64.Type),
        #"Added Custom" = 
        Table.AddColumn(
            #"Added Index", "Custom", each 
        if [Index] >= 0 then    
            let
                __id = #"Added Index"{[Index]}[Person ID],
                __pDate = #"Added Index"{[Index]}[#"Date/Time Out"],
                __cdate = [#"Date/Time In"]
            in
                if __id = [Person ID] and 
                     Date.From(__pDate) =  Date.From(__cdate)                     
                then
                     Duration.From(__cdate-__pDate)
                else 
                    null else null, type duration
        ) 
    in
        #"Added Custom"

     



  • Thanks for the quick response. 

     

    I am trying to calculate the time from swiping off, and then returning to site to swipe back on - not just 24-onsite_time. 

    Person IDDate/Time InDate/Time Out
    ID_727907-Sep-2023 6:09:5507-Sep-2023 9:45:06
    ID_727907-Sep-2023 10:00:0507-Sep-2023 12:04:30
    ID_727914-Sep-2023 12:00:5314-Sep-2023 17:50:41
    ID_727915-Sep-2023 6:14:1815-Sep-2023 9:33:20
    ID_727915-Sep-2023 9:47:4715-Sep-2023 12:42:32
    ID_727915-Sep-2023 13:00:0115-Sep-2023 18:07:08
    ID_727916-Sep-2023 6:12:1316-Sep-2023 10:52:44
    ID_727916-Sep-2023 11:12:2116-Sep-2023 18:21:50
    ID_725017-Sep-2023 6:44:4817-Sep-2023 9:17:27
    ID_727917-Sep-2023 9:28:2717-Sep-2023 12:51:47
    ID_727917-Sep-2023 13:21:0217-Sep-2023 19:51:39
    ID_727918-Sep-2023 5:21:4818-Sep-2023 8:37:29
    ID_727918-Sep-2023 9:04:4418-Sep-2023 13:06:57
    ID_727918-Sep-2023 13:06:5718-Sep-2023 18:29:58
    ID_727919-Sep-2023 7:03:4819-Sep-2023 10:22:12
    ID_725019-Sep-2023 10:40:4519-Sep-2023 14:28:39
    ID_725019-Sep-2023 15:01:5419-Sep-2023 17:46:31
    ID_727920-Sep-2023 6:57:0620-Sep-2023 8:38:20
    ID_727920-Sep-2023 9:20:1120-Sep-2023 13:27:59
    ID_727913-Oct-2023 10:04:3613-Oct-2023 12:21:53
    ID_727913-Oct-2023 12:35:5513-Oct-2023 16:41:43
    ID_727914-Oct-2023 5:55:3514-Oct-2023 18:29:56
    ID_725015-Oct-2023 6:38:1515-Oct-2023 11:32:31
    ID_725015-Oct-2023 11:52:3115-Oct-2023 18:28:18
    ID_725016-Oct-2023 6:00:0516-Oct-2023 11:20:30
    ID_725016-Oct-2023 11:38:5516-Oct-2023 17:32:19
    ID_727917-Oct-2023 8:36:0817-Oct-2023 18:05:47
    ID_727918-Oct-2023 6:14:5318-Oct-2023 9:05:25
    ID_727918-Oct-2023 9:26:2418-Oct-2023 14:10:13
    ID_727918-Oct-2023 14:31:0618-Oct-2023 18:24:40
    ID_725019-Oct-2023 5:29:0919-Oct-2023 5:32:03
    ID_725019-Oct-2023 5:32:0319-Oct-2023 12:10:27
    ID_725026-Oct-2023 9:56:3426-Oct-2023 16:43:50
    ID_725027-Oct-2023 6:00:5927-Oct-2023 11:18:51
    ID_727927-Oct-2023 11:33:4427-Oct-2023 17:40:26
    ID_727928-Oct-2023 6:00:4628-Oct-2023 11:33:24
    ID_725028-Oct-2023 11:52:1328-Oct-2023 17:29:32
  • dufoq3's avatar
    dufoq3
    Community Champion

    Hi bocajpedersen, I know that this topic is few months old, but if you have big dataset - consider using this query (this one is much faster)

     

    Result

    let
        fnShift = (tbl as table, col as text, shift as nullable number, optional newColName as text, optional _type as type) as table =>
            //v 3. parametri zadaj zaporne cislo ak chces posunut riadky hore, kladne ak dole, 4. je nepovinny (novy nazov stlpca), 5. je nepovinny typ
            let
                a = Table.Column(tbl, col),
                b = if shift = 0 or shift = null then a else if shift > 0
                    then List.Repeat({null}, shift) & List.RemoveLastN(a, shift)
                    else List.RemoveFirstN(a, shift * -1) & List.Repeat({null}, shift * -1),    
                c = Table.FromColumns(Table.ToColumns(tbl) & {b}, Table.ColumnNames(tbl) &
                    ( if newColName <> null then {newColName} else
                        if shift = 0 then {col & "_Duplicate"} else
                        if shift > 0 then {col & "_PrevValue"} 
                        else              {col & "_NextValue"} )),
                d = Table.TransformColumnTypes(c, {List.Last(Table.ColumnNames(c)), if _type <> null then _type else type any})
            in
                d,
    
        Source = Table.FromRows(Json.Document(Binary.Decompress(Binary.FromText("fZW7jt0wDER/Jbj1XoCiSD1Yp0mVIuVikSJInyL/jwztDSxSuwZcGAczFs2XXl8f377+7Nzn4+VB/fnj958nE9cvzWiaaqLTRI3a4+3lM18hIzzZWNhIrFJyFokSMq0Zd1MyKdmpa6xFrIxEp9VqvJ0YFNLxJIo4hK3yjbHU4ydLxsOoG43sbCFUtlITRdIUp8qNsRR3csl4gCFBlxPvkIRKipiMRKchsdzziUHBwxWRIggtnrTPjcgOYiLOeLqzzuwcl0TdeIa60GEVod75pjcX0hepV6mZbqF+JEkYP45ot0LOS4I61/dQZygko76cyxElgkczFk/3mp3didFDrSVj9HCzmgeEaW0B7T62keK4sQ/IqkALkJWSqNcXQ7kVpD6///p7bQGMe8uYj26td06Mnp6LJ2B0MVpjc8olcRe8ib6XsuW86iVpnoeiiWLgKoe0bkZI9JAkPLyUZWRnW4/8vyRXiu8h33Ub5ihBsLo5uwdbtpL0S4JqN99NkfrK0g/GeayxojfPtbzQ6T7WGx+apxlLor6pyTfg50ZIajnbNWCkFVO+ZWeuLYBa09wockP11ncqIvVNTWFHHkZu6z8qukcS9Wat+1LmnhpAZ6K+5FHdbZSjBNfasesC7r5VON/MPNKR0hI9v8eSYx25zY9LK2Bfysc9+fYP", BinaryEncoding.Base64), Compression.Deflate)), let _t = ((type nullable text) meta [Serialized.Text = true]) in type table [#"Person ID" = _t, #"Date/Time In" = _t, #"Date/Time Out" = _t]),
        Custom1 = if UseRepeatValue = "Yes" then Table.Repeat(Source, RepeatValue) else Source,
        ChangedType = Table.TransformColumnTypes(Custom1,{{"Person ID", type text}, {"Date/Time In", type datetime}, {"Date/Time Out", type datetime}}),
        Ad_DateIn = Table.AddColumn(ChangedType, "Date In", each DateTime.Date([#"Date/Time In"]), type date),
        Ad_DateOut = Table.AddColumn(Ad_DateIn, "Date Out", each DateTime.Date([#"Date/Time Out"]), type date),
        // Added [Date/Time Out_PrevValue] into inner [All] table
        GroupedRows = Table.Group(Ad_DateOut, {"Person ID", "Date In", "Date Out"}, {{"All", each fnShift(_, "Date/Time Out", 1, null, type datetime), type table}}),
        CombinedAll = Table.Combine(GroupedRows[All]),
        Ad_TimeSincePreviousEntray = Table.AddColumn(CombinedAll, "Time Since Previous Entry", each [#"Date/Time In"] - [#"Date/Time Out_PrevValue"], type duration),
        RemovedColumns = Table.RemoveColumns(Ad_TimeSincePreviousEntray,{"Date/Time Out_PrevValue", "Date In", "Date Out"})
    in
        RemovedColumns