Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
3 years ago

Incremental refresh Power BI dataset, how does it work?

Hello   I have built a view (an aggregate) on a 35 billion row SQLServer table, 7 years of history. Every day around 14 million rows are added. The view is used in Incremental Refresh (1 Days) The...
Need Help
Anonymous's avatar
Anonymous
Not applicable
3 years ago

Hi, query folding is there. The problem is that the main query is in a Common Table Expression, meaning I presume it will read everytime the whole table. And I think the wait type CXCONSUMER is there because it is waiting for data to consume. But I am not sure

  • Wilson_'s avatar
    Wilson_
    Icon for Memorable Member rankMemorable Member
    3 years ago

    Hello,

     

    I'm not sure. You can probably take the native query from Power Query (I'm guessing it will add the date filters to the WHERE clause?) and check the query plan in SQL and compare it to an unfilitered query plan to see what changes when it runs through incremental refresh (or at least when it's filtered between RangeStart and RangeEnd, hah).

     

    Just some thoughts.


    ----------------------------------
    If this post helps, please consider accepting it as the solution to help other members find it quickly. Also, don't forget to hit that thumbs up and subscribe! (Oh, uh, wrong platform?)