Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
4 years ago

Incremental refresh on dataset and dataflow

We have incremental refresh on our dataflows where several dataset is pulling from. 

Some of the dataset is quit large and I'm considering using incremental refresh on the dataset aswell. 

 

I wondering if there any downside/upside using incremental refresh on a dataflow that allready have incremental refresh?  

Dataflow
Need Help

4 Replies

  • GilbertQ's avatar
    GilbertQ
    Super User
    4 years ago

    Hi Anonymous 

     

    I would recommend doing it, the incremental refresh makes everything a lot quicker to process. And who does not like things happening quicker?

  • Anonymous's avatar
    Anonymous
    Not applicable
    4 years ago

    Hi Anonymous ,

     

    With dataflows, you can bring large amounts of data into Power BI or your organization's provided storage. In some cases, however, it's not practical to update a full copy of source data in each refresh. A good alternative is incremental refresh, which provides the following benefits for dataflows:

    • Refresh occurs faster: Only data that's changed needs to be refreshed. For example, refresh only the last five days of a 10-year dataflow.
    • Refresh is more reliable: For example, it's not necessary to maintain long-running connections to volatile source systems.
    • Resource consumption is reduced: Less data to refresh reduces overall consumption of memory and other resources.

    Notice: Using incremental refresh in dataflows created in Power BI requires that the dataflow reside in a workspace in Premium capacity. 

     

    For more information,please see:Using incremental refresh with dataflows 

     

    Hope it helps,


    Community Support Team _ Caitlyn

    If this post helps then please consider Accept it as the solution to help the other members find it more quickly.

     

    • Anonymous's avatar
      Anonymous
      Not applicable
      4 years ago

      hi Anonymous 

      I mainly wondering if there is any problems doing the incremental refresh when the source is dataflow. 

      • Anonymous's avatar
        Anonymous
        Not applicable
        4 years ago

        Hi Anonymous ,

         

        What is the problem you are referring to, I may not understand very well.

        Dataflow incremental refresh and dataset incremental refresh are designed to work in tandem. It's acceptable and supported to have an incrementally refreshing entity in a dataflow, fully loaded into a dataset, or a fully loaded entity in a dataflow incrementally loaded to a dataset.

        Both approaches work according to your specified definitions in the refresh settings.

         

        Hope it helps,


        Community Support Team _ Caitlyn

        If this post helps then please consider Accept it as the solution to help the other members find it more quickly.