Forum Discussion

ESE_fh's avatar
ESE_fh
Frequent Visitor
3 years ago
Solved

Get all combined subDirectories with Folder.Contents() from multiple servers (mainDirectories),

Dear Pro-Users, most likely an easy question,  What is a performant PQ best practice to query Folder.Contents (directories only) from different servers/directories? starting from a table with all d...
Show and Tell
  • lbendlin's avatar
    lbendlin
    3 years ago

    No, you need to bring out the big guns.  AD extracts, Purview, Scanner API.  Low code/no code tools tend to be overwhelmed when confronted with massive amounts of data.

lbendlin's avatar
lbendlin
Super User
3 years ago

Remember that the Folder connector gives you all folder names for free.

 

let
    Source = Folder.Files("\\192.168.3.8\pi"),
    #"Removed Other Columns" = Table.SelectColumns(Source,{"Folder Path"}),
    #"Removed Duplicates" = Table.Distinct(#"Removed Other Columns")
in
    #"Removed Duplicates"

So no need to loop through anything again.

ESE_fh's avatar
ESE_fh
Frequent Visitor
3 years ago

Thank for a lot your hint and response.
Folder.files won't work because response time exceeds common user acceptance (explanation see above)

regards

  • lbendlin's avatar
    lbendlin
    Super User
    3 years ago

    Unless your data sources ( the file servers ) can help with periodic/fast meta data exports I don't think you'll have much luck making this any faster.