Forum Discussion

jessimica1018's avatar
jessimica1018
Helper II
4 years ago
Solved

Lookup for multiple columns

Hey all! I am creating phone anaylsis reports for our recruiting team but have run into some issues. Our phone vendor's raw data is just gross but cannot be changed; all it contains is some emails and some phone numbers with call time and directionality of the call (few other fields but there are the only that matter currently).  I am trying to add names, divisions, departments...etc...  from our HCM system, which I super dynamic and call pull in any piece of data needed. However I am having issues getting the two to talk and pull data in nicely. I need a best practice here:

 

Phone Data:    Internal (basically corporate) staff has User ID's as their email address but our external staff  (contractors) do not have user ID's in the phone data but we do have phone numbers.

 

From User IDFrom NumberTo User IDTo Number DirectionDateTotal Minutes
[email protected]1112223333 1231231234OutBound3/2/2211
[email protected]1112223334 1231231235OutBound2/27/2212
 1231231235[email protected]1112223334InBound2/28/2220
 1231231234[email protected]1112223333InBound3/1/2216

 

HCM Data:  We have all the data

Employee NameEmailHome NumberWork Number
John Internal[email protected] 1112223333
Jane Internal[email protected] 1112223334
Person1 External[email protected]1231231234 
Person2 External[email protected]1231231235 

 

 

Ultimate End Result so I can build a beautiful dashboard:

FromToDirectionDateTotal Minutes
John InternalPerson1 ExternalOutBound3/2/202211
Jane InternalPerson2 ExternalOutBound2/27/202212
Person2 ExternalJane InternalInBound2/28/202220
Person1 ExternalJohn InternalInBound3/1/202216

 

I have my models connected by "From User ID" and "Email"; but then it's not picking up those external numbers nor is it picking up the phone calls "To" anyone. I have been racking my brain on how to make this connect properly. I've done a DAX Vlookup but and  could get "From User ID" to pull correctly but all other fields didn't work. I tried Merging Queries but I don't think that is the best way since it's more of a "If this cell is blank then vlookup this column" type deal. 

 

 

Anyone have any recommendations on how to make this mess work??? 

 

Thank you!!!  

 

  • lbendlin's avatar
    lbendlin
    4 years ago

    The link works. Now please describe the rules for the matching.  Here is an example based on just the phone numbers (and adding to the Employees table).  

     

     

     

    let
      Source = Excel.Workbook(File.Contents("c:\users\xxx\Downloads\EE Data.xlsx"), null, true), 
      Page1_Sheet = Source{[Item = "Page1", Kind = "Sheet"]}[Data], 
      #"Promoted Headers" = Table.PromoteHeaders(Page1_Sheet, [PromoteAllScalars = true]), 
      #"Changed Type" = Table.TransformColumnTypes(
        #"Promoted Headers", 
        {
          {"Company Code", type text}, 
          {"Employee Number", Int64.Type}, 
          {"Current Status", type text}, 
          {"Employee Name", type text}, 
          {"Email Address", type text}, 
          {"Home Phone", Int64.Type}, 
          {"Work Phone", Int64.Type}
        }
      ), 
      #"Added Custom" = Table.AddColumn(
        #"Changed Type", 
        "Calls", 
        (k) =>
          Table.SelectRows(
            #"Phone Data", 
            each [From Number] = k[Home Phone] 
              or [From Number] = k[Work Phone] 
              or [To Number] = k[Home Phone] 
              or [To Number] = k[Work Phone]
          )
      )
    in
      #"Added Custom"

     

    You may not want that, instead you may want to add a column to the phone records table that tags the employee.

    let
        Source = Csv.Document(File.Contents("C:\users\xxx\downloads\Phone Data.csv"),[Delimiter=",", Columns=9, Encoding=1252, QuoteStyle=QuoteStyle.None]),
        #"Promoted Headers" = Table.PromoteHeaders(Source, [PromoteAllScalars=true]),
        #"Changed Type" = Table.TransformColumnTypes(#"Promoted Headers",{{"LinkedID", type text}, {"From User ID", type text}, {"From Number", Int64.Type}, {"To User ID", type text}, {"To Number", Int64.Type}, {"Direction", type text}, {"Date", type date}, {"Minutes", Int64.Type}, {"Disposition", type text}}),
        #"Added Custom" = Table.AddColumn(#"Changed Type", "Custom",  (k)=> 
    Table.SelectRows(#"EE Data",
    each k[From Number]=[Home Phone]
       or k[From Number]=[Work Phone]
       or k[To Number]=[Home Phone]
       or k[To Number]=[Work Phone])),
        #"Expanded Custom" = Table.ExpandTableColumn(#"Added Custom", "Custom", {"Email Address"}, {"Email Address"})
    in
        #"Expanded Custom"

     

12 Replies

  • If you want to limit yourself to DAX you will need to run multiple LOOKUPVALUE queries.

     

    In Power Query you have much more flexibility. You can use Table.AddColumn with a custom generator function to implement fuzzy joins across multiple columns with all kinds of weird rules.  It ain't fast, but is extremely powerful.

    • jessimica1018's avatar
      jessimica1018
      Helper II

      I am for sure your answer is the solution! However I have never done a fuzzy join across multiple columns. Can you point me in the right direction (video, article...etc)? I kept trying to find how with the information you provided but just couldn't find the right thing I think.

       

      Thank you!!

      • lbendlin's avatar
        lbendlin
        Super User

        I think I have posted this example a couple of times. Here's the basic premise:

         

        let
            Source = Table.AddColumn(TableA, "Match", 
                (k) => 
                        Table.SelectRows(TableB,
                                each ([Column1]="*" or k[Column1]=[Column1])
                                     and ([Column2]="*" or k[Column2]=[Column2])
                                     and ([Column3]="*" or k[Column3]=[Column3])
                        )
            ),
        

         

        In the custom generator function you specify whatever whacky join logic you have.  In the next step you then expand the result as needed.

         

        What are your join rules?