Advance your Data & AI career with 50 days of live learning, dataviz contests, hands-on challenges, study groups & certifications and more!
Get registeredJoin us at FabCon Atlanta from March 16 - 20, 2026, for the ultimate Fabric, Power BI, AI and SQL community-led event. Save $200 with code FABCOMM. Register now.
Hi guys, I need help on the power query . My intention here is to remove the duplicate value for line and date . what i want is to make it so the query will only remove rows that has null value in [From] if any duplicate are found. Table below as an example:-
before
| Date | Line | From |
| 1/1/2023 | 701 | 1 |
| 1/1/2023 | 701 | Null |
| 1/1/2023 | 701 | 1 |
| 1/2/2023 | 701 | 1 |
1/2/2023 | 702 | 1 |
1/2/2023 | 702 | Null |
1/3/2023 | 701 | Null |
what i expected the result to be
1) Row from 1/1/2023 [Line] 701 with null value on [From] is removed.
2) Row from 1/2/203 [Line] 702 with null value on [From] is removed.
3) Row from 1/3/2023 [Line]701 with null value on [From] is kept because no duplicate valuefor [Date] and [Line].
| Date | Line | From |
| 1/1/2023 | 701 | 1 |
| 1/1/2023 | 701 | 1 |
| 1/2/2023 | 701 | 1 |
1/2/2023 | 702 | 1 |
1/3/2023 | 701 | Null |
Appreciate if anyone can help me on this. Thank you!
Solved! Go to Solution.
Hello, @screamout_93
let
Source = your_table,
#"Grouped Rows" = Table.Group(Source, {"Date", "Line"}, {{"Count", each Table.RowCount(_), Int64.Type}, {"rows", each _, type table [Date=datetime, Line=number, From=any]}}),
#"Added Custom" = Table.AddColumn(#"Grouped Rows", "new_rows", each if [Count] > 1 then Table.SelectRows([rows], (x) => x[From] <> "Null") else [rows]),
result = Table.Combine(#"Added Custom"[new_rows])
in
result
Hello, @screamout_93
let
Source = your_table,
#"Grouped Rows" = Table.Group(Source, {"Date", "Line"}, {{"Count", each Table.RowCount(_), Int64.Type}, {"rows", each _, type table [Date=datetime, Line=number, From=any]}}),
#"Added Custom" = Table.AddColumn(#"Grouped Rows", "new_rows", each if [Count] > 1 then Table.SelectRows([rows], (x) => x[From] <> "Null") else [rows]),
result = Table.Combine(#"Added Custom"[new_rows])
in
result
Thank you! your a lifesaver.
Advance your Data & AI career with 50 days of live learning, contests, hands-on challenges, study groups & certifications and more!
Check out the October 2025 Power BI update to learn about new features.