Is incremental refresh possible

[MasterSonic]

Hi guys,

Long story short,

I open all excel files from SharePoint folder ( names of files are in date format 2022-10-10 and being added as a column to the table)

As amount of files is growing, how can I reduce load time, so only latest file/or recent files would be loaded?

( I want to keep all existing data in my dataset)

I thought of incremental refresh.

My understanding was it could work where we have some columns with dates. Would that be applicable in my case where only date is newly created column based on field name?

[v-yanjiang-msft]

Hi @MasterSonic ,

Is your problem solved? If so, would you mind accept the helpful replies as solutions? Then we are able to close the thread. More people who have the same requirment will find the solution quickly and benefit here, thank you!

Best Regards,
Community Support Team _ kalyj

[HoangHugo]

Hi,

In Power Query, right click and uncheck "Include in Report refresh" to stop file you don't want to refresh more

[MasterSonic]

Hi there, 

In my case I have just one table here. I invoke custom function so all files from folder are transformed and appended at once. 

 

[Anonymous · Accepted solution]

Hi @MasterSonic ,

Refer this document, By using additional custom query functions and query logic, incremental refresh can be used with other types of data sources provided filters based on RangeStart and RangeEnd can be passed in a single query. For example, Excel workbook files stored in a folder, files in SharePoint, or RSS feeds. 

Please refer to the following document for more information.

Incremental refresh for files in a Folder or SharePoint - Power BI — The Power User

https://www.youtube.com/watch?v=BQahH53ayKU

www.poweredsolutions.co

Best Regards,

Neeko Tang

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.