Forum Discussion
automatically pickup files at sharepoint folder
i receive csv file on daily basis in specific sharepoint folder, the structure of file is same everyday with columns order_id, product_id, order_date, sales_amount. file naming convention follow standard as "Sales_current_date.csv" , example Sales_23_09_2025.csv, Sales_24_09_2025.csv etc.
i want to acheive below objectives in Power BI:
1. i need to append all files data in single table in power bi
2. power bi should automatically pickup the new file everyday and append data for that file in main table without manually loading file and appending data everyday
Hello,
Yes it is possible,
You have to use the sharepoint folder connector and connect to the site (to the site, note the library) , the url should like to: https://sharepointTenant.com/sites/YourSite
Here, it will retrieve the whole content of your site, so this is why the filterint steps is very important
First, you have to apply a filter to only return the files you need to add
Something like
Start with:Sales_ & end with: .csv
Then, you just have to combine by clickling on the button next to content
Now, each time a file with the same naming convention will be added in your sharepoint, it will be automatically added to your table
To have this automatic refresh, you have to schedule an automatic refresh in Power BI services, and every day, you will have your report with the right data
This is my table before a refresh:
Then I added a file in my sharepoint folder and click on refresh:
If you need more help, do not hesistate to ask 😉
6 Replies
- rohit1991
Super User
1. In Power BI Desktop, go to Get Data > More > SharePoint Folder.
- Enter only the site URL (e.g., https://company.sharepoint.com/sites/YourSite).
2. In the Navigator window, select your folder and click Transform Data.
3. In Power Query, filter the Name column to keep files starting with "Sales_".
4. Click Combine Files (from the Content column).
-
Power BI will combine all matching CSVs into one table automatically.
5. Make sure column names (like order_id, order_date, sales_amount) are consistent in all files.
6. Click Close & Apply, your single combined table will load into Power BI.
7. Publish to Power BI Service and set up a Scheduled Refresh (daily).
8. It will automatically:
-
Check the SharePoint folder
-
Pick up new CSV files (e.g., Sales_25_09_2025.csv)
-
Append them to the existing table
- Cookistador
Super User
Hello,
Yes it is possible,
You have to use the sharepoint folder connector and connect to the site (to the site, note the library) , the url should like to: https://sharepointTenant.com/sites/YourSite
Here, it will retrieve the whole content of your site, so this is why the filterint steps is very important
First, you have to apply a filter to only return the files you need to add
Something like
Start with:Sales_ & end with: .csv
Then, you just have to combine by clickling on the button next to content
Now, each time a file with the same naming convention will be added in your sharepoint, it will be automatically added to your table
To have this automatic refresh, you have to schedule an automatic refresh in Power BI services, and every day, you will have your report with the right data
This is my table before a refresh:
Then I added a file in my sharepoint folder and click on refresh:
If you need more help, do not hesistate to ask 😉
- AnonymousNot applicable
Hi powerbiexpert22
I wanted to check if you had the opportunity to review the information provided. Please feel free to contact us if you have any further questions.
Thank you. - AnonymousNot applicable
May I check if this issue has been resolved? If not, Please feel free to contact us if you have any further questions.
Thank you - adudani
Memorable Member
HI powerbiexpert22 ,
Appreciate everyone for their valuable input.
I believe you need to perform a combination of techiniques from the reference videos below which is similar to others' responses in the comments.
- (1) Connect Excel / CSV files from SharePoint to Excel or Power BI - YouTube
- Combine Data from Multiple Excel Files | Most Dynamic Method (Dynamic Columns & Sheets) - YouTube
- Shubham_rai955
Super User
To automatically append daily CSV files from a SharePoint folder, use Power BI’s SharePoint folder connector. Connect to the folder (not individual files), which enables Power BI to detect and combine all files with the same structure automatically. Ensure your files follow a consistent naming pattern like “Sales_dd_mm_yyyy.csv”. Set up scheduled refresh in Power BI Service to refresh data daily and pick up new files without manual intervention. Optionally, integrate Power Automate to trigger dataset refresh immediately after the file upload for near real-time updates.