Incremental refresh using only most recent files in a Sharepoint Folder

[SHDJason]

Hi, 

I have several sharepoint folder that have gotten very full. They are updated daily with new data exports. PBI refreshes daily using the folder as a data source. Is there a way to do an incremental refresh so it appends the dataset with data from only the most recent files rather than refreshing from the entire folder each time?

If not directly in PBI, what about using other automation tools like Power Flows? 

Thanks.

[Greg_Deckler]

@SHDJason Could certainly probably get there with Power Automate and Power BI REST API. Outside of that, I assume you are using a Folder query? You could probably create a duplicate Folder query and then in the original Folder query filter out files with Created On dates after a certain period. In your other Folder query, filter out files with Created On dates before the same period. Disable refresh on the original query. Create an Append Query or append query step in new query to append the other queries' data.

@ me if you have questions.