Don't miss your chance to take the Fabric Data Engineer (DP-600) exam for FREE! Find out how by attending the DP-600 session on April 23rd (pacific time), live or on-demand.
Learn moreNext up in the FabCon + SQLCon recap series: The roadmap for Microsoft SQL and Maximizing Developer experiences in Fabric. All sessions are available on-demand after the live show. Register now
Hi guys, I need help on the power query . My intention here is to remove the duplicate value for line and date . what i want is to make it so the query will only remove rows that has null value in [From] if any duplicate are found. Table below as an example:-
before
| Date | Line | From |
| 1/1/2023 | 701 | 1 |
| 1/1/2023 | 701 | Null |
| 1/1/2023 | 701 | 1 |
| 1/2/2023 | 701 | 1 |
1/2/2023 | 702 | 1 |
1/2/2023 | 702 | Null |
1/3/2023 | 701 | Null |
what i expected the result to be
1) Row from 1/1/2023 [Line] 701 with null value on [From] is removed.
2) Row from 1/2/203 [Line] 702 with null value on [From] is removed.
3) Row from 1/3/2023 [Line]701 with null value on [From] is kept because no duplicate valuefor [Date] and [Line].
| Date | Line | From |
| 1/1/2023 | 701 | 1 |
| 1/1/2023 | 701 | 1 |
| 1/2/2023 | 701 | 1 |
1/2/2023 | 702 | 1 |
1/3/2023 | 701 | Null |
Appreciate if anyone can help me on this. Thank you!
Solved! Go to Solution.
Hello, @screamout_93
let
Source = your_table,
#"Grouped Rows" = Table.Group(Source, {"Date", "Line"}, {{"Count", each Table.RowCount(_), Int64.Type}, {"rows", each _, type table [Date=datetime, Line=number, From=any]}}),
#"Added Custom" = Table.AddColumn(#"Grouped Rows", "new_rows", each if [Count] > 1 then Table.SelectRows([rows], (x) => x[From] <> "Null") else [rows]),
result = Table.Combine(#"Added Custom"[new_rows])
in
result
Hello, @screamout_93
let
Source = your_table,
#"Grouped Rows" = Table.Group(Source, {"Date", "Line"}, {{"Count", each Table.RowCount(_), Int64.Type}, {"rows", each _, type table [Date=datetime, Line=number, From=any]}}),
#"Added Custom" = Table.AddColumn(#"Grouped Rows", "new_rows", each if [Count] > 1 then Table.SelectRows([rows], (x) => x[From] <> "Null") else [rows]),
result = Table.Combine(#"Added Custom"[new_rows])
in
result
Thank you! your a lifesaver.
If you have recently started exploring Fabric, we'd love to hear how it's going. Your feedback can help with product improvements.
A new Power BI DataViz World Championship is coming this June! Don't miss out on submitting your entry.
Share feedback directly with Fabric product managers, participate in targeted research studies and influence the Fabric roadmap.
| User | Count |
|---|---|
| 6 | |
| 3 | |
| 3 | |
| 3 | |
| 2 |