Forum Discussion

sharpedogs's avatar
sharpedogs
Advocate II
6 years ago
Solved

Hourly Updates multiple files from a folder -

I'm not sure what to do here?   1) I'm reporting against Server Utilization  2) Each Hour there are 7 CSV files dropped into a folder  3) I pull all files from the folder and merge them together ...
Need Help
  • v-juanli-msft's avatar
    v-juanli-msft
    6 years ago

    Hi sharpedogs 

    You could add a step "filtered rows",

    #"Filtered Rows" = Table.SelectRows(#"Changed Type", each DateTime.Date([datetime])=DateTime.Date(DateTime.LocalNow()) and Time.Hour([datetime])<= Time.Hour(DateTime.LocalNow()) and Time.Hour([datetime])>= Time.Hour(DateTime.LocalNow())-1)

     

    Best Regards
    Maggie
    Community Support Team _ Maggie Li
    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
edhans's avatar
edhans
Community Champion
6 years ago

Just grab the latest file with each refresh. Make sure you use the Folder import option, then the Combine opreation, which it sounds like you are doing. That will prevent the import from looking at a specific file name.

 

Set this filter though right before the combine operation starts: