Forum Discussion

powerbiexpert22's avatar
powerbiexpert22
Icon for Impactful Individual rankImpactful Individual
11 months ago
Solved

automatically pickup files at sharepoint folder

i receive csv file on daily basis in specific sharepoint folder, the structure of file is same everyday with columns order_id, product_id, order_date, sales_amount.  file naming convention follow standard as "Sales_current_date.csv" , example Sales_23_09_2025.csv, Sales_24_09_2025.csv etc.

 

i want to acheive below objectives in Power BI:

1. i need to append all files data in single table in power bi

2. power bi should automatically pickup the new file everyday and append data for that file in main table without manually loading file and appending data everyday

  • Hello,

    Yes it is possible, 

    You have to use the sharepoint folder connector and connect to the site (to the site, note the library) , the url should like to: https://sharepointTenant.com/sites/YourSite 

    Here, it will retrieve the whole content of your site, so this is why the filterint steps is very important

    First, you have to apply a filter to only return the files you need to add

    Something like

    Start with:Sales_ & end with: .csv 

    Then, you just have to combine by clickling on the button next to content

     

    Now, each time a file with the same naming convention will be added in your sharepoint, it will be automatically added to your table

     

    To have this automatic refresh, you have to schedule an automatic refresh in Power BI services, and every day, you will have your report with the right data

     

    This is my table before a refresh:

     

     

    Then I added a file in my sharepoint folder and click on refresh:

     

     

    If you need more help, do not hesistate to ask 😉

6 Replies

  • Hi powerbiexpert22 

     

    1. In Power BI Desktop, go to Get Data > More > SharePoint Folder.

    2. In the Navigator window, select your folder and click Transform Data.

    3. In Power Query, filter the Name column to keep files starting with "Sales_".

    4. Click Combine Files (from the Content column).

    • Power BI will combine all matching CSVs into one table automatically.

    5. Make sure column names (like order_id, order_date, sales_amount) are consistent in all files.

    6. Click Close & Apply, your single combined table will load into Power BI.

    7. Publish to Power BI Service and set up a Scheduled Refresh (daily).

    8. It will automatically:

    • Check the SharePoint folder

    • Pick up new CSV files (e.g., Sales_25_09_2025.csv)

    • Append them to the existing table

     

  • Hello,

    Yes it is possible, 

    You have to use the sharepoint folder connector and connect to the site (to the site, note the library) , the url should like to: https://sharepointTenant.com/sites/YourSite 

    Here, it will retrieve the whole content of your site, so this is why the filterint steps is very important

    First, you have to apply a filter to only return the files you need to add

    Something like

    Start with:Sales_ & end with: .csv 

    Then, you just have to combine by clickling on the button next to content

     

    Now, each time a file with the same naming convention will be added in your sharepoint, it will be automatically added to your table

     

    To have this automatic refresh, you have to schedule an automatic refresh in Power BI services, and every day, you will have your report with the right data

     

    This is my table before a refresh:

     

     

    Then I added a file in my sharepoint folder and click on refresh:

     

     

    If you need more help, do not hesistate to ask 😉

  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi powerbiexpert22 
    I wanted to check if you had the opportunity to review the information provided. Please feel free to contact us if you have any further questions.


    Thank you.

  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi powerbiexpert22 

    May I check if this issue has been resolved? If not, Please feel free to contact us if you have any further questions.


    Thank you

  • To automatically append daily CSV files from a SharePoint folder, use Power BI’s SharePoint folder connector. Connect to the folder (not individual files), which enables Power BI to detect and combine all files with the same structure automatically. Ensure your files follow a consistent naming pattern like “Sales_dd_mm_yyyy.csv”. Set up scheduled refresh in Power BI Service to refresh data daily and pick up new files without manual intervention. Optionally, integrate Power Automate to trigger dataset refresh immediately after the file upload for near real-time updates.