Skip to main content
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Get inspired! Check out the entries from the Power BI DataViz World Championships preliminary rounds and give kudos to your favorites. View the vizzies.

Reply
Mike1983
Regular Visitor

How to count consecutive date ranges in Power Query M?

‎04-03-2024 03:20 AM

Hello! Hopefully someone can help me!

 

I have a table of absence start and end dates (300k rows). Where absences are consecutive (previous end date is the day before the next start date), I want to capture the first of the consecutive dates in that series as Consecutive Abs Start. It could be any number of absences in a consecutive series. Please see the desired result below. I want to do this in PowerQuery M (instead of PowerBI DAX front end) so I can use the result further in my transformations.

 

If anyone can help me that would be great! Thanks.  Mike

 

 

PersonAbs StartAbs EndConsecutive Abs Start (desired result)
2000000101.01.202402.01.202401.01.2024
2000000115.01.202417.01.202415.01.2024
2000000118.01.202419.01.202415.01.2024
2000000120.01.202420.01.202415.01.2024
2000000121.01.202421.01.202415.01.2024
2000000122.01.202422.01.202415.01.2024
2000000123.01.202423.01.202415.01.2024
2000000101.02.202401.02.202401.02.2024
2000000115.02.202415.02.202415.02.2024
2000000116.02.202416.02.202415.02.2024
2000000101.03.202401.03.202401.03.2024

 

 

 

Labels:
Message 1 of 4
1,057 Views
0
1 ACCEPTED SOLUTION
dufoq3
Super User
Super User

‎04-03-2024 04:10 AM

Hi @Mike1983,

 

Result:

dufoq3_0-1712143918501.png

 

let
    Source = Table.FromRows(Json.Document(Binary.Decompress(Binary.FromText("ddDRCoAgDIXhd/FaYjuW1bOI7/8atgg7jSbe/PDBdK0lyH005SS6XBeC1QIzev4w3YjpHrKD2RkxCDEKz/htFJ6BWfgFFGYlYrYQzIW88bOQySg8q8xqxGxO4aFP9D4A", BinaryEncoding.Base64), Compression.Deflate)), let _t = ((type nullable text) meta [Serialized.Text = true]) in type table [Person = _t, #"Abs Start" = _t, #"Abs End" = _t]),
    #"Changed Type" = Table.TransformColumnTypes(Source,{{"Abs Start", type date}, {"Abs End", type date}}, "sk-SK"),
    #"Added Index1" = Table.AddIndexColumn(#"Changed Type", "IndexHelper", 0, 1, Int64.Type),
    #"Added Dates" = Table.AddColumn(#"Added Index1", "Dates", each List.Dates([Abs Start], Duration.TotalDays([Abs End] - [Abs Start])+1, #duration(1,0,0,0)), type list),
    #"Expanded Dates" = Table.ExpandListColumn(#"Added Dates", "Dates"),
    #"Added Index" = Table.AddIndexColumn(#"Expanded Dates", "Index", 0, 1, Int64.Type),
    #"Grouped Rows" = Table.Group(#"Added Index",
        {"Person", "Dates", "Index"}, { {"All", each _, type table}, {" Consecutive Abs Start", each List.Min([Dates]), type date}},
        GroupKind.Local,
        (s,c)=> Byte.From(c[Index]-s[Index] <> Duration.Days(c[Dates]-s[Dates]))),
    #"Expanded All" = Table.ExpandTableColumn(#"Grouped Rows", "All", {"Abs Start", "Abs End", "IndexHelper"}, {"Abs Start", "Abs End", "IndexHelper"}),
    #"Removed Duplicates" = Table.Distinct(#"Expanded All", {"IndexHelper"}),
    #"Removed Columns" = Table.RemoveColumns(#"Removed Duplicates",{"IndexHelper", "Dates", "Index"})
in
    #"Removed Columns"

 


Note: Check this link to learn how to use my query.
Check this link if you don't know how to provide sample data.

View solution in original post

Message 2 of 4
1,043 Views
3 REPLIES 3
dufoq3
Super User
Super User

‎04-03-2024 04:10 AM

Hi @Mike1983,

 

Result:

dufoq3_0-1712143918501.png

 

let
    Source = Table.FromRows(Json.Document(Binary.Decompress(Binary.FromText("ddDRCoAgDIXhd/FaYjuW1bOI7/8atgg7jSbe/PDBdK0lyH005SS6XBeC1QIzev4w3YjpHrKD2RkxCDEKz/htFJ6BWfgFFGYlYrYQzIW88bOQySg8q8xqxGxO4aFP9D4A", BinaryEncoding.Base64), Compression.Deflate)), let _t = ((type nullable text) meta [Serialized.Text = true]) in type table [Person = _t, #"Abs Start" = _t, #"Abs End" = _t]),
    #"Changed Type" = Table.TransformColumnTypes(Source,{{"Abs Start", type date}, {"Abs End", type date}}, "sk-SK"),
    #"Added Index1" = Table.AddIndexColumn(#"Changed Type", "IndexHelper", 0, 1, Int64.Type),
    #"Added Dates" = Table.AddColumn(#"Added Index1", "Dates", each List.Dates([Abs Start], Duration.TotalDays([Abs End] - [Abs Start])+1, #duration(1,0,0,0)), type list),
    #"Expanded Dates" = Table.ExpandListColumn(#"Added Dates", "Dates"),
    #"Added Index" = Table.AddIndexColumn(#"Expanded Dates", "Index", 0, 1, Int64.Type),
    #"Grouped Rows" = Table.Group(#"Added Index",
        {"Person", "Dates", "Index"}, { {"All", each _, type table}, {" Consecutive Abs Start", each List.Min([Dates]), type date}},
        GroupKind.Local,
        (s,c)=> Byte.From(c[Index]-s[Index] <> Duration.Days(c[Dates]-s[Dates]))),
    #"Expanded All" = Table.ExpandTableColumn(#"Grouped Rows", "All", {"Abs Start", "Abs End", "IndexHelper"}, {"Abs Start", "Abs End", "IndexHelper"}),
    #"Removed Duplicates" = Table.Distinct(#"Expanded All", {"IndexHelper"}),
    #"Removed Columns" = Table.RemoveColumns(#"Removed Duplicates",{"IndexHelper", "Dates", "Index"})
in
    #"Removed Columns"

 


Note: Check this link to learn how to use my query.
Check this link if you don't know how to provide sample data.

Message 2 of 4
1,044 Views
Mike1983
Regular Visitor
In response to dufoq3

‎04-04-2024 06:07 AM

Fantastic, thank you. I got there in the end but I used about 10 times as many steps, this is certainly much more elegant. 

Message 3 of 4
973 Views
0
dufoq3
Super User
Super User
In response to Mike1983

‎04-04-2024 06:18 AM

You're welcome Mike. Enjoy. Don't forget that your data needs to be sorted by Abs Start.


Note: Check this link to learn how to use my query.
Check this link if you don't know how to provide sample data.

Message 4 of 4
963 Views
0

Helpful resources

Announcements
Las Vegas 2025

Join us at the Microsoft Fabric Community Conference

March 31 - April 2, 2025, in Las Vegas, Nevada. Use code FABINSIDER for a $400 discount!

FebPBI_Carousel

Power BI Monthly Update - February 2025

Check out the February 2025 Power BI update to learn about new features.

March2025 Carousel

Fabric Community Update - March 2025

Find out what's new and trending in the Fabric community.

View All