Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

The Power BI Data Visualization World Championships is back! Get ahead of the game and start preparing now! Learn more

Reply
Anonymous
Not applicable

Duplicate rows / cached data?

Rather a basic problem but hoping someone can help.

 

I have a bunch of data input files (18) stored in one folder, all in exactly the same structure. I'm then using Power Query in a "summary" file to simply look at that folder and import all of the data in them into the summary file one after another, effectively just combining the data across multiple files into one so I can then analyse the data in full.

 

This was all working well, but recently I have noticed some rows are being duplicated, or if updated / removed from an input file are still showing in the summary file as a separate row to the updated data. 

 

How can I tell if the data is being cached or similar as rows are showing in the summary file which no longer exist in the input files?

3 REPLIES 3
AbhinavJoshi
Responsive Resident
Responsive Resident

Hi @Anonymous. When you make changes to the source data/input file are you refreshing your data as well in Power BI Dekstop, are there any errors refereshing data?

Anonymous
Not applicable

Starts with basic function to Get Data from Folder, selecting the sheet name that is consistent across the files, and then ignores the top X rows (not needed) of the input sheets until you get to the table header row. From that point it just pulls everything in. 

lbendlin
Super User
Super User

You would have to show (a sanitized version of) your Power Query code. Did you use the boilerplate mechanism to combine files or did you create your own process? Do you have any query dependencies that may override the "Include in Refresh"  flag?

Helpful resources

Announcements
Power BI DataViz World Championships

Power BI Dataviz World Championships

The Power BI Data Visualization World Championships is back! Get ahead of the game and start preparing now!

December 2025 Power BI Update Carousel

Power BI Monthly Update - December 2025

Check out the December 2025 Power BI Holiday Recap!

FabCon Atlanta 2026 carousel

FabCon Atlanta 2026

Join us at FabCon Atlanta, March 16-20, for the ultimate Fabric, Power BI, AI and SQL community-led event. Save $200 with code FABCOMM.

Top Solution Authors