Forum Discussion

po's avatar
po
Post Prodigy
6 years ago
Solved

Incremental Refresh in Pro?

Hi,   Believe we use power bi pro.   Have read incremebtal refresh is available in power bi premium   I  have a few questions and wondered if anyone could answer   1) Any idea when incrementa...
  • v-frfei-msft's avatar
    6 years ago

    Hi po ,

     

    For the 1st question, as the idea, MS are  definitely planning on adding Incremental refresh to Pro.

     

    can pro detect this e.g pick up any updates to existing data as well as newly inserted data to base table importing.  Also what about deletes to base table are they reflected in incremental resfresh?

     

     


    The answer should be no, as for the incremental refresh, datasets are filtered by using Power Query date/time parameters with the reserved, case-sensitive names RangeStart and RangeEnd.

     

    3)  Believe pro has a 10gb file size limit?

          Fact table concerned which would have incremental refresh would have several hundred million rows 

    Any rough estimate as to largest fact table say under 10 columns e.g date_loaded, sales_qty, custtomer_no and product_no

     

    For the size of the fact table, the issue with that is Power BI uses a columnar compression algorithm to compress data. So, you would have to understand exactly how that algoritm works and exactly what data you have. For example, if you have lots of the same value in a column, that will compress very well, but if you have lots of unique values, that will compress less well.