Forum Discussion

campelliann's avatar
campelliann
Icon for Post Patron rankPost Patron
1 year ago
Solved

Does it make sense to incremental refresh this dataflow?

Hi there, 
I have a dataflow which results in 2 million rows, the source is a SQL database and we have incremental refresh for the dataflow.

Now my question is, does it make sense a second incremental refresh? In powerquery the only step is basically Powerbidataflows(), and navegation to load the table. Still there are 2 million rows to be imported to the model, would incremental refresh make sense here?.

Many thanks

Need Help
  • Jonvoge's avatar
    Jonvoge
    1 year ago

    Hi campelliann

     

    With 2 million rows of data I would personally not bother with Incremental Refresh in my semantic model.

    How long does your model take to refresh? I have seen models with 100 million rows refresh in few minutes.

     

    In my opinion, Incremental Refresh should be used when your refresh performance is not sufficient. Not when you reach a certain number of rows.

    _____________________________________________________
    I hope my comment was helpful.
    If your question was answered, please mark your post as 'Solved' and consider giving me a 'Thumbs Up'.
    Find me on LinkedIn, Sessionize, or my blog Downhill Data

2 Replies

  • Jonvoge's avatar
    Jonvoge
    Icon for Most Valuable Professional rankMost Valuable Professional
    1 year ago

    Hi campelliann

     

    With 2 million rows of data I would personally not bother with Incremental Refresh in my semantic model.

    How long does your model take to refresh? I have seen models with 100 million rows refresh in few minutes.

     

    In my opinion, Incremental Refresh should be used when your refresh performance is not sufficient. Not when you reach a certain number of rows.

    _____________________________________________________
    I hope my comment was helpful.
    If your question was answered, please mark your post as 'Solved' and consider giving me a 'Thumbs Up'.
    Find me on LinkedIn, Sessionize, or my blog Downhill Data