Forum Discussion

campelliann's avatar
campelliann
Icon for Post Patron rankPost Patron
2 years ago
Solved

Does it make sense to incremental refresh this dataflow?

Hi there,  I have a dataflow which results in 2 million rows, the source is a SQL database and we have incremental refresh for the dataflow. Now my question is, does it make sense a second increm...
Need Help
  • Jonvoge's avatar
    Jonvoge
    2 years ago

    Hi campelliann

     

    With 2 million rows of data I would personally not bother with Incremental Refresh in my semantic model.

    How long does your model take to refresh? I have seen models with 100 million rows refresh in few minutes.

     

    In my opinion, Incremental Refresh should be used when your refresh performance is not sufficient. Not when you reach a certain number of rows.

    _____________________________________________________
    I hope my comment was helpful.
    If your question was answered, please mark your post as 'Solved' and consider giving me a 'Thumbs Up'.
    Find me on LinkedIn, Sessionize, or my blog Downhill Data

Jonvoge's avatar
Jonvoge
Icon for Most Valuable Professional rankMost Valuable Professional
2 years ago

Hi campelliann

 

With 2 million rows of data I would personally not bother with Incremental Refresh in my semantic model.

How long does your model take to refresh? I have seen models with 100 million rows refresh in few minutes.

 

In my opinion, Incremental Refresh should be used when your refresh performance is not sufficient. Not when you reach a certain number of rows.

_____________________________________________________
I hope my comment was helpful.
If your question was answered, please mark your post as 'Solved' and consider giving me a 'Thumbs Up'.
Find me on LinkedIn, Sessionize, or my blog Downhill Data