Forum Discussion
Web Directory of CSV files, incremental data refresh
- 6 years ago
Hi Anonymous
Do you mean you'd like to automatically fetch new files in the directory into power bi ?
Are the files all in the same format, for example csv (comma separated values)?
Is it important that each file ends up in a separate table?
You can use Get Data - Other - Folder to ask Power Query to grab all files in a specified folder. On each refresh, all data in that folder will be read so when new files are added, they will be read into the model upon refresh. You can also use all methods available in Power Query to shape the data as you see fit. All input will however end up in one table, but with a column containing the file name so it should be a simple matter to extract the date from the file name in that column in order to allow processing of date separated data.
You might refer to this similar thread which appends new excel automatically:
https://community.powerbi.com/t5/Desktop/Get-data-from-folder-and-append/td-p/526274
Anonymous , refer if this can help
https://www.howtoexcel.org/power-query/how-to-extract-data-from-multiple-webpages/