Forum Discussion

AnandGNR's avatar
AnandGNR
Icon for Helper I rankHelper I
4 years ago

Incremental Refresh takes almost same time as Full refresh in PBI Service

Hi, I have set up incremental refresh on 2 fact tables that are part of my dataset. I have given an active range of 12 months with an archive of 2 years and use LastModified to detect changes. I kno...
Need Help
Prachi0202's avatar
Prachi0202
Frequent Visitor
2 years ago

Hello all,

I have almost 4 GB dataset and I have Incremental Refresh on the Sales fact table as below:

Incremental refresh is taking almost 50-55 minutes and the normal refresh was taking 60-65 minutes. Can someone help me in knowing how to tackle the issue?

Data Connectivity is Import and database is Azure Synapse. And Power BI dataset is used.

lbendlin's avatar
lbendlin
Icon for Super User rankSuper User
2 years ago

Use SSMS or DAX Studio to check how many partitions that table has 

  • Prachi0202's avatar
    Prachi0202
    Frequent Visitor
    2 years ago

    I am trying the Incremental refresh now with the XMLA end-point and the partitions I can see are as below for now

    As the incremental is on UpdateDate, is the reason all 2022 records count is in 2023.
    Lets us see how much time this XMLA method takes. But need to understand has anyone used this method for Incremental Refresh and how you find it working?
    Is it helpful in resolving the long time refresh with the Incrementsl refresh?

    Regards,

    Prachi

    • lbendlin's avatar
      lbendlin
      Icon for Super User rankSuper User
      2 years ago

      You cannot use UpdateDate for incremental refresh, that will lead to data duplicates. Use something immutable like CreatedDate.

      • Prachi0202's avatar
        Prachi0202
        Frequent Visitor
        2 years ago

        Update date is the date when data is loaded from source to the destination so I think its same a the created date, and we have Incremental Refresh set just for a day.