Forum Discussion

ESE_fh's avatar
ESE_fh
Frequent Visitor
3 years ago
Solved

Get all combined subDirectories with Folder.Contents() from multiple servers (mainDirectories),

Dear Pro-Users, most likely an easy question,  What is a performant PQ best practice to query Folder.Contents (directories only) from different servers/directories? starting from a table with all d...
Show and Tell
  • lbendlin's avatar
    lbendlin
    3 years ago

    No, you need to bring out the big guns.  AD extracts, Purview, Scanner API.  Low code/no code tools tend to be overwhelmed when confronted with massive amounts of data.

ESE_fh's avatar
ESE_fh
Frequent Visitor
3 years ago

Thank you for your response and hint. The limiting externality is the amount of files and resulting response time.
Folder.Files() would be nice, but each file-server contains millions of files in constantly changing directories.

Table.Combine(Folder.Files("\\server01\???"),  Folder.Files("\\server02\???"), more...) requires hours to answer.

 

The (common?) SME use case is a dynamic, multiple folder-select starting from different main directories.


Loop: For fast response, the user selects folders level by level. Easier approach highly appreciated
Step1: User-select of server(s)    & call Folder.Contents( "get only (next) 1st level directories for selection" )
Step2: User-select of 1st.folders & call Folder.Contents( "get only (next) 2nd level directories for selection" )
Step3: User-select of 2st.folders & call Folder.Contents( "get only (next) 3rd level directories for selection" )
stop if no further user select, else continue loop until last deepest level

more PQ-conformant approach would be great help

Regards