Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
4 years ago
Solved

Pickup new subdirectory on Refresh

Hi,

 

Well I am looking to do exactly as the title asks. I can load files and merge/transform if they are in one folder but here's the situation. The is a directory where users drop month end csv reports. For each report drop, they are stored in the own month

 

So structure is Base Folder -> Year -> Month -> report.csv

 

All csv are exactly the same. How can I load from Base Folder and get all files such that when it refreshes month end it pickups the new folder drop.

 

All the files are in a sharepoint. N.B there are other dirctories apart from Base Folder. i.e each other department has its own data but I need only my department
i.e
Products -> 2022 -> Jan -> report*.csv

Products -> 2022 -> Feb -> report*.csv

Orders -> 2022 -> Jan -> report*.csv

Orders -> 2022 -> Feb -> report*.csv

 

I only need to read the Products ones.

  • Rather than picking specific FilePaths, you can filter the FilePath column with a text filter that contains "Products".

     

    Pat

2 Replies

  • mahoneypat's avatar
    mahoneypat
    Icon for Microsoft Employee rankMicrosoft Employee

    Rather than picking specific FilePaths, you can filter the FilePath column with a text filter that contains "Products".

     

    Pat

    • Anonymous's avatar
      Anonymous
      Not applicable

      Haha thanks, simple solution yet it works.

      I was filtering using the path itself not a contains. It works perfect.

      Highly appreciated.