Forum Discussion
How to use List.Generate to find continous ranges?
Hi Guys,
my input data:
NameVacation Date
| Smith | 09.03.2023 00:00:00 |
| Smith | 06.08.2023 00:00:00 |
| Smith | 07.08.2023 00:00:00 |
| Smith | 08.08.2023 00:00:00 |
| Smith | 09.08.2023 00:00:00 |
| Lisa | 01.07.2023 00:00:00 |
| John | 14.06.2023 00:00:00 |
| John | 15.06.2023 00:00:00 |
| Anne | 05.04.2023 00:00:00 |
| Anne | 06.04.2023 00:00:00 |
| Anne | 07.04.2023 00:00:00 |
| Anne | 08.04.2023 00:00:00 |
| Anne | 09.04.2023 00:00:00 |
| Anne | 18.05.2023 00:00:00 |
| Anne | 19.05.2023 00:00:00 |
| Anne | 20.05.2023 00:00:00 |
| Anne | 21.05.2023 00:00:00 |
| Anne | 22.05.2023 00:00:00 |
| Anne | 05.09.2023 00:00:00 |
and now i grouped rows:
let
Source = #"Table1 (3)",
GroupedRows = Table.Group(Source, {"Name"}, {{"Grp", each
let a = _,
b = Table.AddIndexColumn(a, "Index", 0, 1, Int64.Type),
counter = 0,
c = Table.AddColumn(b, "Vacation No", each
let
d = b[Vacation Date],
CounterState = List.Generate(
() => [IndexNo=1, CounterValue = 1, PrevDate=d{1}],
each [CounterValue] < 5,
each [
CounterValue = 1,
PrevDate = d{1}
],
each [CounterValue]
)
in CounterState
)
in c}})
in
GroupedRows
so what i want to do is for each person generate list of continuous ranges.
Output should be:
| Name | Vacation No | Vacation From Date | Vacation End Date | Number of Workdays |
| Smith | 1 | 09.03.2023 | 09.03.2023 | 1 |
| Smith | 2 | 07.08.2023 | 09.08.2023 | 3 |
| John | 1 | 14.06.2023 | 15.06.2023 | 2 |
| Anne | 1 | 05.04.2023 | 07.04.2023 | 3 |
| Anne | 2 | 18.05.2023 | 22.05.2023 | 3 |
| Anne | 3 | 05.09.2023 | 05.09.2023 | 1 |
so as you can see i need to use List.Generate to add record with Vacation No, Workdays, Vacation From Date and Vacation End Date.
I stacked because List.Generate is creating a list inside each row, but I have issues with:
1) How to set up start of list:
d = b[Vacation Date] = i am looping always through whole list which is not necessary, I want to just start from specific row.
2) how to use date time functions and duration to specify if days are next to each other?
In this step, I want to build lists only for specific rows and check if ranges are continuous (if day diff <> 1 , then it is not continuous range and should reset whole loop and start from specific date)
Will be grateful for any help,
Best,
Jacek
Hello, jaryszek you can do everything in 1 step using Table.Group. I would not bother with List.Generate. Here is basic idea: sort by names and dates, then group as long as names are equal and dates are back to back. The latter is a little bit tricky but doable: add index column and compare duration in days between first and current row and difference in values of index column. Key is GroupKind.Local argument of Table.Group. Sorting order is also super important. I grouped rows for you that each row is a single vacation event. Do the rest yourself (add end date as max date, working days calculation etc as you usually do in Table.Group). Hope this was helpful.
let sort = Table.Sort(#"Table1 (3)",{{"Name", Order.Ascending}, {"Vacation Date", Order.Ascending}}), idx = Table.AddIndexColumn(sort, "Index", 1, 1, Int64.Type), g = Table.Group( idx, {"Name", "Vacation Date", "Index"}, {"all", each _}, GroupKind.Local, (s, c) => Byte.From( (s[Name] <> c[Name]) or (Duration.Days(c[Vacation Date] - s[Vacation Date]) <> (c[Index] - s[Index])) ) ) in g
8 Replies
- AlienSx
Super User
Hello, jaryszek you can do everything in 1 step using Table.Group. I would not bother with List.Generate. Here is basic idea: sort by names and dates, then group as long as names are equal and dates are back to back. The latter is a little bit tricky but doable: add index column and compare duration in days between first and current row and difference in values of index column. Key is GroupKind.Local argument of Table.Group. Sorting order is also super important. I grouped rows for you that each row is a single vacation event. Do the rest yourself (add end date as max date, working days calculation etc as you usually do in Table.Group). Hope this was helpful.
let sort = Table.Sort(#"Table1 (3)",{{"Name", Order.Ascending}, {"Vacation Date", Order.Ascending}}), idx = Table.AddIndexColumn(sort, "Index", 1, 1, Int64.Type), g = Table.Group( idx, {"Name", "Vacation Date", "Index"}, {"all", each _}, GroupKind.Local, (s, c) => Byte.From( (s[Name] <> c[Name]) or (Duration.Days(c[Vacation Date] - s[Vacation Date]) <> (c[Index] - s[Index])) ) ) in g- jaryszek
Super User
Thank you very much AlienSx !
It is very nice solution.
If i do not want to have dates on weekends here (like Sunday or Saturaday) i would add somethins like here?:
not List.Contains({5,6}, Date.DayOfWeek(c[Vacation Date]))(s, c) => Byte.From(
(s[Name] <> c[Name]) or
(Duration.Days(c[Vacation Date] - s[Vacation Date]) <> (c[Index] - s[Index])) and
not List.Contains({5,6}, Date.DayOfWeek(c[Vacation Date]))
)
So it means that 06.07.2023 will be removed from table, it is weekend day...
and one more question, how to debug state and current state? Sometimes it is hard to imagine what is happening there...
Best,
Jacek- AlienSx
Super User
jaryszek no, don't do anything to what's inside Byte.From. Inside is in fact a condition to start new group. But Table.Group requires 0/1 as a result of this function so we have to use either Number.From or Byte.From which converts logical to 1 or 0.
If you want to calculate the number of working days then add another aggregated column withing Table.Group:{"wd", (x) => List.Count(List.Select(x[Vacation Date], (d) => not List.Contains({5, 6}, Date.DayOfWeek(d)))}
with regard to s and c: I don't know how you can debug this. "s" stands for "state" (or first row of this group). "c" stands for "current" - current row of the group and you evaluate (s, c) => for being equal to 1 or 0.
And you can work with only table fields mentioned as column names in Table.Group 2nd argument. We have a condition with index, vacation date and name columns. So that we have to mention them as a list argument of Table.Group. From the other side if you evaluate just 1 field, then you can mention it's name in Table.Group without curley brackets and don't use [ ] in (s, c). List this: Table.Group(source, "column_name", ..., (s, c) => Byte.From(c - s >= 10))