Forum Discussion

Mrquestionmark's avatar
Mrquestionmark
Helper I
4 years ago
Solved

M query using folder.contents questions

I have almost 20K files in the folder and I only need to load some of files based on naming. In my M query, I am using folder.contents first and then filter out the files after.   But the challenge...
Need Help
  • Anonymous's avatar
    Anonymous
    4 years ago

    Spread out the files into different folders

  • Anonymous's avatar
    Anonymous
    4 years ago

    let
        Source = Table.FromColumns({Lines.FromBinary(File.Contents("D:\folder\index.txt"), null, null, 936)}),
        #"Filtered Rows" = Table.SelectRows(Source, each Text.StartsWith([Column1], "wanted")),
        #"Added Custom" = Table.AddColumn(#"Filtered Rows", "path", each "D:\folder\" & [Column1]),
        #"Added Custom1" = Table.AddColumn(#"Added Custom", "Content", each File.Contents([path]))
    in
        #"Added Custom1"

Mrquestionmark's avatar
Mrquestionmark
Helper I
4 years ago

Hi GSun,

 

Thanks for your quick turnaround. 

 

I am not the owner of the files and not the option to spread the files. 

For your second suggestions, how can I make it in M query to only load the files I need?

 

Thanks,

W

Anonymous's avatar
Anonymous
Not applicable
4 years ago

let
    Source = Table.FromColumns({Lines.FromBinary(File.Contents("D:\folder\index.txt"), null, null, 936)}),
    #"Filtered Rows" = Table.SelectRows(Source, each Text.StartsWith([Column1], "wanted")),
    #"Added Custom" = Table.AddColumn(#"Filtered Rows", "path", each "D:\folder\" & [Column1]),
    #"Added Custom1" = Table.AddColumn(#"Added Custom", "Content", each File.Contents([path]))
in
    #"Added Custom1"

  • Mrquestionmark's avatar
    Mrquestionmark
    Helper I
    4 years ago

    Hi Gsun,

     

    This is smart. It worked.

     

    Thans for your help!

    W