Forum Discussion

MasterSonic's avatar
MasterSonic
Helper IV
3 years ago
Solved

Is incremental refresh possible

Hi guys,

Long story short,

I open all excel files from SharePoint folder ( names of files are in date format 2022-10-10 and being added as a column to the table)

 

As amount of files is growing, how can I reduce load time, so only latest file/or recent files would be loaded?

( I want to keep all existing data in my dataset)

 

I thought of incremental refresh.

 

My understanding was it could work where we have some columns with dates. Would that be applicable in my case where only date is newly created column based on field name?

 

 

4 Replies

  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi MasterSonic ,

     

    Refer this documentBy using additional custom query functions and query logic, incremental refresh can be used with other types of data sources provided filters based on RangeStart and RangeEnd can be passed in a single query. For example, Excel workbook files stored in a folder, files in SharePoint, or RSS feeds. 

     

    Please refer to the following document for more information.

    Incremental refresh for files in a Folder or SharePoint - Power BI — The Power User

    https://www.youtube.com/watch?v=BQahH53ayKU

    www.poweredsolutions.co

     

    Best Regards,

    Neeko Tang

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly. 

     

  • HoangHugo's avatar
    HoangHugo
    Solution Specialist

    Hi,

    In Power Query, right click and uncheck "Include in Report refresh" to stop file you don't want to refresh more

     

    • MasterSonic's avatar
      MasterSonic
      Helper IV

      Hi there, 

      In my case I have just one table here. I invoke custom function so all files from folder are transformed and appended at once. 

  • Hi MasterSonic ,

    Is your problem solved? If so, would you mind accept the helpful replies as solutions? Then we are able to close the thread. More people who have the same requirment will find the solution quickly and benefit here, thank you!

     

    Best Regards,
    Community Support Team _ kalyj