Solved: Rolling last 12 months of data append table

rkee10 · ‎12-05-2024

I would like to ask for some help in updating the table whenever i have a new file in my sharepoint folder. The data source is excel which are provided on a daily basis. My ask for help is how I can append the new items on the existing ones in pbix. FOr example, I am going to have the whole 2024 data on January 1, 2025. Now, Jan 1 2025 data will be uploaded so instead of the whole 12 months including the Jan 1 2025 data, i just need to pick the Jan 1 2025 data and append on the existing 2024 whole year table in pbix. Let me know if this is not clear. Thanks and appreciate it!

rohit1991 · ‎12-06-2024

Hi, hope these steps help you out.

To append new daily data to an existing dataset in Power BI while working with SharePoint as your data source, follow these steps:

1. Connect to SharePoint Folder

In Power BI, go to Home → Get Data → SharePoint Folder.
Enter your SharePoint site URL and connect.

2. Filter for New Data: In the Power Query editor, apply a filter based on file names, file dates, or other metadata to load only the new files (e.g., files with dates in the name or a "Date Modified" column). Example: Filter files uploaded after the most recent date already in your dataset.

3. Extract and Clean Data: Combine the relevant files and ensure the data structure matches the existing dataset. Use transformations (if needed) to clean the data to match your existing format.

4. Append Data

Load the new filtered data.
Append it to the existing dataset:
- In Power Query, choose Append Queries and select your existing table and the new data.
- Ensure the column names and data types align.

5. Set Up Incremental Refresh (Optional): If you have a large dataset, enable Incremental Refresh: Go to the table's properties. Define the parameters for "Range Start" and "Range End" to process only the new data for each refresh.

Did it work? ✔ Give a Kudo • Mark as Solution – help others too!

View solution in original post

rohit1991 · ‎12-06-2024

Hi, hope these steps help you out.

To append new daily data to an existing dataset in Power BI while working with SharePoint as your data source, follow these steps:

1. Connect to SharePoint Folder

In Power BI, go to Home → Get Data → SharePoint Folder.
Enter your SharePoint site URL and connect.

2. Filter for New Data: In the Power Query editor, apply a filter based on file names, file dates, or other metadata to load only the new files (e.g., files with dates in the name or a "Date Modified" column). Example: Filter files uploaded after the most recent date already in your dataset.

3. Extract and Clean Data: Combine the relevant files and ensure the data structure matches the existing dataset. Use transformations (if needed) to clean the data to match your existing format.

4. Append Data

Load the new filtered data.
Append it to the existing dataset:
- In Power Query, choose Append Queries and select your existing table and the new data.
- Ensure the column names and data types align.

5. Set Up Incremental Refresh (Optional): If you have a large dataset, enable Incremental Refresh: Go to the table's properties. Define the parameters for "Range Start" and "Range End" to process only the new data for each refresh.

Did it work? ✔ Give a Kudo • Mark as Solution – help others too!

danextian · ‎12-06-2024

Hi @rkee10

Sorry. You want to append the last 12 months or just the new data from 2025?
If the latter, you will need to keep at least two queries - one for 2024 that is connected to the 2024 file and the other one for the 2025 file. You will then need to combine these two using the append feature. You can just append 2025 to 2024 and disable the loading for 2025.

Dane Belarmino | Microsoft MVP | Proud to be a Super User!

Did I answer your question? Mark my post as a solution!

"Tell me and I’ll forget; show me and I may remember; involve me and I’ll understand."
Need Power BI consultation, get in touch with me on LinkedIn or hire me on UpWork.
Learn with me on YouTube @DAXJutsu or follow my page on Facebook @DAXJutsuPBI.

Rolling last 12 months of data append table

1. Connect to SharePoint Folder

2. Filter for New Data: In the Power Query editor, apply a filter based on file names, file dates, or other metadata to load only the new files (e.g., files with dates in the name or a "Date Modified" column). Example: Filter files uploaded after the most recent date already in your dataset.

3. Extract and Clean Data: Combine the relevant files and ensure the data structure matches the existing dataset. Use transformations (if needed) to clean the data to match your existing format.

4. Append Data

5. Set Up Incremental Refresh (Optional): If you have a large dataset, enable Incremental Refresh: Go to the table's properties. Define the parameters for "Range Start" and "Range End" to process only the new data for each refresh.

1. Connect to SharePoint Folder

2. Filter for New Data: In the Power Query editor, apply a filter based on file names, file dates, or other metadata to load only the new files (e.g., files with dates in the name or a "Date Modified" column). Example: Filter files uploaded after the most recent date already in your dataset.

3. Extract and Clean Data: Combine the relevant files and ensure the data structure matches the existing dataset. Use transformations (if needed) to clean the data to match your existing format.

4. Append Data

5. Set Up Incremental Refresh (Optional): If you have a large dataset, enable Incremental Refresh: Go to the table's properties. Define the parameters for "Range Start" and "Range End" to process only the new data for each refresh.

Helpful resources

New to Fabric Survey

Power BI DataViz World Championships - June 2026

Join our Fabric User Panel

Power BI Community Update - March 2026

How to Get Your Question Answered Quickly

Get Fabric certified for FREE!

Rolling last 12 months of data append table

1. Connect to SharePoint Folder

2. Filter for New Data: In the Power Query editor, apply a filter based on file names, file dates, or other metadata to load only the new files (e.g., files with dates in the name or a "Date Modified" column). Example: Filter files uploaded after the most recent date already in your dataset.

3. Extract and Clean Data: Combine the relevant files and ensure the data structure matches the existing dataset. Use transformations (if needed) to clean the data to match your existing format.

4. Append Data

5. Set Up Incremental Refresh (Optional): If you have a large dataset, enable Incremental Refresh: Go to the table's properties. Define the parameters for "Range Start" and "Range End" to process only the new data for each refresh.

1. Connect to SharePoint Folder

2. Filter for New Data: In the Power Query editor, apply a filter based on file names, file dates, or other metadata to load only the new files (e.g., files with dates in the name or a "Date Modified" column). Example: Filter files uploaded after the most recent date already in your dataset.

3. Extract and Clean Data: Combine the relevant files and ensure the data structure matches the existing dataset. Use transformations (if needed) to clean the data to match your existing format.

4. Append Data

5. Set Up Incremental Refresh (Optional): If you have a large dataset, enable Incremental Refresh: Go to the table's properties. Define the parameters for "Range Start" and "Range End" to process only the new data for each refresh.

Helpful resources

New to Fabric Survey

Power BI DataViz World Championships - June 2026

Join our Fabric User Panel

Power BI Community Update - March 2026

How to Get Your Question Answered Quickly