Get certified in Microsoft Fabric—for free! For a limited time, the Microsoft Fabric Community team will be offering free DP-600 exam vouchers. Prepare now
Hi!
I need help creating an index column in Power Query.
I would like to index rows with same ID based on the Date in ascending order.
I would like it to look something like this:
ID | Sub ID | Date | Index |
ABC | ABC1 | 2020-01-01 | 1 |
ABC | ABC2 | 2020-01-02 | 2 |
ABC | ABC3 | 2020-01-03 | 3 |
ABC | ABC4 | 2020-01-04 | 4 |
DEF | DEF1 | 2020-01-02 | 1 |
DEF | DEF2 | 2020-01-05 | 4 |
DEF | DEF3 | 2020-01-04 | 3 |
DEF | DEF4 | 2020-01-03 | 2 |
I have tried to do the following steps:
1 sort Date acending
2 Group by ID (all rows into "Rank")
3 create a index column with: Table.AddIndexColumn([Rank], "Index", 1, 1))
4 Expand to new rows.
The problem is that the first sorting step seems to be ignored. I'm new to this and can't figure out another way to solve it. I'd be so happy and thankful for your help!
Cheers!
Solved! Go to Solution.
Hello @Anonymous
this code should do the trick
let
Source = #table
(
{"ID","Sub ID","Date"},
{
{"ABC","ABC1","2020-01-01"}, {"ABC","ABC2","2020-01-02"}, {"ABC","ABC3","2020-01-03"}, {"ABC","ABC4","2020-01-04"}, {"DEF","DEF1","2020-01-02"}, {"DEF","DEF2","2020-01-05"},
{"DEF","DEF3","2020-01-04"}, {"DEF","DEF4","2020-01-03"}
}
),
ToDate = Table.TransformColumns
(
Source,
{
{
"Date",
each Date.From(_,"en-US"),
type date
}
}
),
Group = Table.Group(ToDate, {"ID"}, {{"AllRows", (tableint) => let sort = Table.Sort(tableint,{"Date", Order.Ascending}), AddIndex = Table.AddIndexColumn(sort,"Index",1) in AddIndex}}),
Expand = Table.ExpandTableColumn(Group, "AllRows", {"Sub ID", "Date", "Index"}, {"Sub ID", "Date", "Index"})
in
Expand
Copy paste this code to the advanced editor in a new blank query to see how the solution works. If this solution fits your need, copy and past a part of it and implement it in your query
If this post helps or solves your problem, please mark it as solution (to help other users find useful content and to acknowledge the work of users that helped you)
Kudoes are nice too
Have fun
Jimmy
Hello @Anonymous
this code should do the trick
let
Source = #table
(
{"ID","Sub ID","Date"},
{
{"ABC","ABC1","2020-01-01"}, {"ABC","ABC2","2020-01-02"}, {"ABC","ABC3","2020-01-03"}, {"ABC","ABC4","2020-01-04"}, {"DEF","DEF1","2020-01-02"}, {"DEF","DEF2","2020-01-05"},
{"DEF","DEF3","2020-01-04"}, {"DEF","DEF4","2020-01-03"}
}
),
ToDate = Table.TransformColumns
(
Source,
{
{
"Date",
each Date.From(_,"en-US"),
type date
}
}
),
Group = Table.Group(ToDate, {"ID"}, {{"AllRows", (tableint) => let sort = Table.Sort(tableint,{"Date", Order.Ascending}), AddIndex = Table.AddIndexColumn(sort,"Index",1) in AddIndex}}),
Expand = Table.ExpandTableColumn(Group, "AllRows", {"Sub ID", "Date", "Index"}, {"Sub ID", "Date", "Index"})
in
Expand
Copy paste this code to the advanced editor in a new blank query to see how the solution works. If this solution fits your need, copy and past a part of it and implement it in your query
If this post helps or solves your problem, please mark it as solution (to help other users find useful content and to acknowledge the work of users that helped you)
Kudoes are nice too
Have fun
Jimmy
Hi!
Thank you so much! That worked perfectly!
Me happy!
try this code, I sort by ID and Date, the order is preserved then
let
Source = Table.FromRows(Json.Document(Binary.Decompress(Binary.FromText("i45WcnRyVtIBkYZAysjAyEDXwBCIlGJ1kOSMkOWMUOWMkeWMUeVMkOVMwHIurm5AQSBpiGkmXA7FPlNUOWM8ZpqguSUWAA==", BinaryEncoding.Base64), Compression.Deflate)), let _t = ((type text) meta [Serialized.Text = true]) in type table [ID = _t, #"Sub ID" = _t, Date = _t]),
#"Changed Type" = Table.TransformColumnTypes(Source,{{"ID", type text}, {"Sub ID", type text}, {"Date", type date}}),
#"Sorted Rows" = Table.Sort(#"Changed Type",{{"ID", Order.Ascending}, {"Date", Order.Ascending}}),
#"Grouped Rows" = Table.Group(#"Sorted Rows", {"ID"}, {{"Rank", each _, type table [ID=text, Sub ID=text, Date=date]}}),
#"Added Custom" = Table.AddColumn(#"Grouped Rows", "Custom", each Table.AddIndexColumn([Rank], "Index", 0, 1)),
#"Removed Other Columns" = Table.SelectColumns(#"Added Custom",{"Custom"}),
#"Expanded Custom" = Table.ExpandTableColumn(#"Removed Other Columns", "Custom", {"ID", "Sub ID", "Date", "Index"}, {"ID", "Sub ID", "Date", "Index"})
in
#"Expanded Custom"
Hi! Thank you so much for taking the time to respond! I did however try exactly those steps in your code. The sorting is correct at first. but when I continue to add steps (like merging tables and adding conditional columns) the sorting is lost and index 1 is no longer on the row with the first date. Is there anyway to get around this problem?
can you share what steps are you making further? is ti possible to add the index after you make these transformations?
I add a column from another table with ”New Dates”.
Then I remove duplicates.
Then I add a conditional column saying: if Index = 1 then New Dates, else Date
Do you remove the duplicates based on [New Dates] or [Date]? one of them and the [Index]? the whole table?
I think removing the duplicates messes with the setup, try making it as specific as you can
Hi @Anonymous ,
Assuming your another table is like that.
Then we can merge tables and add a custom column in the merged one.
if [Index] = 1 then [Table.new date] else [Date]
M code for your reference.
let
Source = Table.FromRows(Json.Document(Binary.Decompress(Binary.FromText("i45WcnRyVtIBkYZAysjAyEDXwBCIlGJ1kOSMkOWMUOWMkeWMUeVMkOVMwHIurm5AQSBpiGkmXA7FPlNUOWM8ZpqguSUWAA==", BinaryEncoding.Base64), Compression.Deflate)), let _t = ((type text) meta [Serialized.Text = true]) in type table [ID = _t, #"Sub ID" = _t, Date = _t]),
#"Changed Type" = Table.TransformColumnTypes(Source,{{"ID", type text}, {"Sub ID", type text}, {"Date", type date}}),
#"Sorted Rows" = Table.Sort(#"Changed Type",{{"ID", Order.Ascending}, {"Date", Order.Ascending}}),
#"Grouped Rows" = Table.Group(#"Sorted Rows", {"ID"}, {{"Rank", each _, type table [ID=text, Sub ID=text, Date=date]}}),
#"Added Custom" = Table.AddColumn(#"Grouped Rows", "Custom", each Table.AddIndexColumn([Rank], "Index", 1, 1)),
#"Removed Other Columns" = Table.SelectColumns(#"Added Custom",{"Custom"}),
#"Expanded Custom" = Table.ExpandTableColumn(#"Removed Other Columns", "Custom", {"ID", "Sub ID", "Date", "Index"}, {"ID", "Sub ID", "Date", "Index"}),
#"Merged Queries" = Table.NestedJoin(#"Expanded Custom", {"Index"}, Table, {"index"}, "Table", JoinKind.LeftOuter),
#"Expanded Table" = Table.ExpandTableColumn(#"Merged Queries", "Table", {"new date"}, {"Table.new date"}),
#"Added Custom1" = Table.AddColumn(#"Expanded Table", "Custom", each if [Index] = 1 then [Table.new date] else [Date]),
#"Sorted Rows1" = Table.Sort(#"Added Custom1",{{"ID", Order.Descending}, {"Index", Order.Ascending}})
in
#"Sorted Rows1"
Hi!
The "new date" table looks like this:
ID | New Date |
ABC | 2020-01-01 |
GHJ | 2020-05-01 |
As soon as i merge another table, the index order gets "flipped" (do not follow the date sorting).
Is there another way to create index column than the one suggested above?
Thanks so much in advance!
can you share the M code for the transformations that you make? You can copy it from Advanced Editor, in the Query Editor Home tab
Check out the October 2024 Power BI update to learn about new features.
Learn from experts, get hands-on experience, and win awesome prizes.
User | Count |
---|---|
69 | |
62 | |
18 | |
16 | |
13 |