Forum Discussion
Deduplication troubles
Im sure im missing something simple but appricate the help. Im importing a big XML file that has some duplications in it. Changes some info for provacy but the main point is I get duplications on t...
Hi Anonymous,
Can you please share some dummy data that keep the raw data structure with expected results? It should help us clarify your scenario and test to coding formula.
How to Get Your Question Answered Quickly
Regards,
Xiaoxin Sheng
Raw data looks like this
| Name | Tracking | Owner | Application | IP | QID |
| server1 | Agent | john | windows | 1.2.3.4 | 112334 |
| server1 | IP | john | windows | 1.2.3.4 | 112334 |
| server2 | Agent | john | linux | 5.6.7.8 | 113445 |
| server2 | IP | john | linux | 5.6.7.8 | 113445 |
| server3 | Agent | john | sql | 10.11.12.13 | 115667 |
| server3 | IP | john | sql | 10.11.12.13 | 115667 |
There are rows wich are duplicates except for the tracking column which is different between the two duplicate row.
I need to find duplicate rows and remove the row with IP in the tracking. End result would be this:
| Name | Tracking | Owner | Application | IP | QID |
| server1 | Agent | john | windows | 1.2.3.4 | 112334 |
| server2 | Agent | john | linux | 5.6.7.8 | 113445 |
| server3 | Agent | john | sql | 10.11.12.13 | 115667 |