Forum Discussion

LarsPedersen's avatar
LarsPedersen
Frequent Visitor
5 years ago
Solved

Simple/poor man’s version of incremental refresh

Hi Community

 

I apologies if this has been asked before.

 

Im seeking an example of an simple/poor man’s version of incremental refresh.

 

I have a report that that have several data sources (csv or excel files), one of the sources is a folder where (small) csv files are frequently added and frequent refresh are needed to have the report up to date.

But another source is a single and very large csv file, that are rarely updated  (i.e. once every other week).

However a report data refresh speed are significantly impacted by the reload of this large csv file.

So Im look for an excample for a solution to only refresh/reload a csv file if the file date are different (newer) than last major refresh, is that posible?

Thanks in advance.

  • Hi LarsPedersen ,

     

    There is not really a non-manul way to do this since you want do want to refresh the large file every so often.  So, if you are not going to use Incremental Refresh you could manually go into the file, turn off the "refresh" option on that particularly data source, then on the day you want it to run you can manually turn it back on.

     

    That may work for you.  But, doing incremental refresh is not that difficult to setup if you follow the instructions in this document if you want to save yourself the manual method:

    Incremental refresh for datasets in Power BI - Power BI | Microsoft Docs

     

     

5 Replies

  • Hi LarsPedersen ,

     

    There is not really a non-manul way to do this since you want do want to refresh the large file every so often.  So, if you are not going to use Incremental Refresh you could manually go into the file, turn off the "refresh" option on that particularly data source, then on the day you want it to run you can manually turn it back on.

     

    That may work for you.  But, doing incremental refresh is not that difficult to setup if you follow the instructions in this document if you want to save yourself the manual method:

    Incremental refresh for datasets in Power BI - Power BI | Microsoft Docs

     

     

    • LarsPedersen's avatar
      LarsPedersen
      Frequent Visitor

      Thanks for your feedback. I'm already using turn off the "refresh" option, you suggest during report develoment etc. I was hoping for a M-code hack (looking at time stamp or something) to automate/stream line this process a bit.   

  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi LarsPedersen ,

     

    It seems that you want to set Incremental refresh for a single data source not all data sources.

     

    An idea similar with what you expect has been submitted in the following link, please vote it up and you can add comments in this idea: Refresh one Data Source

     

    For more information, please refer to:

    Using incremental refresh with dataflows | Microsoft Docs

    Configure incremental refresh for Power BI datasets - Power BI | Microsoft Docs

     

    Best Regards,
    Eyelyn Qin
    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

    • LarsPedersen's avatar
      LarsPedersen
      Frequent Visitor

      Thanks for your reply. I've voted the request up as suggested.

  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi LarsPedersen ,


    Could you tell me if my post helps you a little? If it is, kindly Accept it as the solution to make the thread closed. More people will benefit from it.

     

    Hope to hear from you‌‌😀

    Best Regards,
    Eyelyn Qin