Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
4 years ago
Solved

filtering and saving into new column

I have 2 column 1st. has strings 2nd column is unique set of words. col1 has 2lac entries col2 has 10000 words 3rd col is blank i want if (col1 row1)contains any word from col2 -----concate that ...
Need Help
  • Vijay_A_Verma's avatar
    Vijay_A_Verma
    4 years ago

    You will need to remove complete Source line in my code and replace that with your source line. _t are generated when you use PQ's Enter Data feature to generate data rather than pulling from a source.

    Use the below new code for your task

    let
    Source = Excel.CurrentWorkbook(){[Name="Table5"]}[Content],
    BuffList1 = List.Buffer(Source[Column1]),
    BuffList2 = List.Buffer(List.RemoveNulls(List.ReplaceValue(Source[Column2],"",null,Replacer.ReplaceValue))),
    BuffList1Count = List.Count(BuffList1),
    GenList = List.Generate(()=>[x=Text.Combine(List.Select(BuffList2,(a)=>List.Contains(Text.Split(BuffList1{0}," "),a, Comparer.OrdinalIgnoreCase)),", "),i=0], each [i]<BuffList1Count, each [i=[i]+1, x=Text.Combine(List.Select(BuffList2,(a)=>List.Contains(Text.Split(BuffList1{i}," "),a, Comparer.OrdinalIgnoreCase)),", ")], each [x]),
    Result = Table.FromColumns(Table.ToColumns(Source)&{GenList},Table.ColumnNames(Source)&{"Result"})
in
    Result
Anonymous's avatar
Anonymous
Not applicable
4 years ago

Vijay_A_Verma  hi i want to use it in my current workbook it is giving error
token identifier expected 
if i remove line-------let _t = ((type nullable text) meta [Serialized.Text = true]) in type table [Column1 = _t, Column2 = _t]),-------
then it works and start generating endless errors 


let
Source = Excel.CurrentWorkbook(){[Name="Table5"]}[Content],
#"Changed Type" = Table.TransformColumnTypes(Source,{{"Column1", type text}, {"Column2", type text}}),

let _t = ((type nullable text) meta [Serialized.Text = true]) in type table [Column1 = _t, Column2 = _t]),
#"Replaced Value" = Table.ReplaceValue(#"Changed Type","",null,Replacer.ReplaceValue,{"Column2"}),
BuffList = List.Buffer(List.RemoveNulls(#"Replaced Value"[Column2])),
#"Added Custom1" = Table.AddColumn(#"Replaced Value", "Result", each Text.Combine(List.Intersect({BuffList,Text.Split([Column1]," ")},Comparer.OrdinalIgnoreCase)," "))
in
#"Added Custom1"

Vijay_A_Verma's avatar
Vijay_A_Verma
Most Valuable Professional
4 years ago

Use this

let
    Source = Excel.CurrentWorkbook(){[Name="Table5"]}[Content],
    #"Changed Type" = Table.TransformColumnTypes(Source,{{"Column1", type text}, {"Column2", type text}}),
    #"Replaced Value" = Table.ReplaceValue(#"Changed Type","",null,Replacer.ReplaceValue,{"Column2"}),
    BuffList = List.Buffer(List.RemoveNulls(#"Replaced Value"[Column2])),
    #"Added Custom1" = Table.AddColumn(#"Replaced Value", "Result", each Text.Combine(List.Intersect({BuffList,Text.Split([Column1]," ")},Comparer.OrdinalIgnoreCase)," "))
in
    #"Added Custom1"
  • Anonymous's avatar
    Anonymous
    Not applicable
    4 years ago

    this is running endless col1 has 18k rows and col2 has 3k,

    it loaded like 2.9L with over 2.5Lac errors

     

    • Vijay_A_Verma's avatar
      Vijay_A_Verma
      Most Valuable Professional
      4 years ago

      Since you have this in Excel, is it possible for you to share your workbook alongwith data and query?

      • Anonymous's avatar
        Anonymous
        Not applicable
        4 years ago

        i am sorry working on company confidential data
        i can complete this in java easy peasy but they have restricted me to query have to learn from scratch.
        In second solution you removed let _t = ((type nullable text) meta [Serialized.Text = true]) in type table [Column1 = _t, Column2 = _t])
        what does this line do?

        after giving the desired output it is running endless loop
        for big data take any string dump in col

        take half dictonary in col 2 and try


        i just copy pasted this

        let
    Source = Excel.CurrentWorkbook(){[Name="Table5"]}[Content],
    #"Changed Type" = Table.TransformColumnTypes(Source,{{"Column1", type text}, {"Column2", type text}}),
    #"Replaced Value" = Table.ReplaceValue(#"Changed Type","",null,Replacer.ReplaceValue,{"Column2"}),
    BuffList = List.Buffer(List.RemoveNulls(#"Replaced Value"[Column2])),
    #"Added Custom1" = Table.AddColumn(#"Replaced Value", "Result", each Text.Combine(List.Intersect({BuffList,Text.Split([Column1]," ")},Comparer.OrdinalIgnoreCase)," "))
in
    #"Added Custom1"