Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
6 years ago

How to Test if Incremental Refresh is Working?

I've set up incremental refresh on a dashboard linking to Athena data source. It refreshes and looks fine, but takes a little longer to refresh than the same report without incremental refresh on (wh...
Need Help
amitchandak's avatar
amitchandak
Icon for Super User rankSuper User
6 years ago

Anonymous 

Not sure I got it. But Typically we check of lastest day weeks data has come into the system or not and match those values with source data sources values.

Anonymous's avatar
Anonymous
Not applicable
6 years ago

Thanks amitchandak , the data has come through, but I'm trying to see if it's improved performance or not. ie. Was it able to *only* query the new data? Currently speed of querying is same as without incremental update so I'm trying to figure out why that is.

  • v-xuding-msft's avatar
    v-xuding-msft
    Icon for Community Support rankCommunity Support
    6 years ago

    Hi Anonymous ,

    You could enable the option of Detect data changes.  If you have a modified DateTime (or updated DateTime) in your table, then the process of incremental refresh can monitor that field, and only get rows that their date/time is after the latest date/time in that field in the previous refresh. To enable this process, you can enable the Detect Data Changes, and then choose the modified date or update date from the table. Notice that this is different from the OrderDate or transaction date. And not all tables have such a field.

     

    All You Need to Know About the Incremental Refresh in Power BI: Load Changes Only

    Power BI Incremental Refresh - Understanding Detect Data Changes 

    • pthapa's avatar
      pthapa
      Icon for Post Patron rankPost Patron
      2 years ago

      I am still confused to the topic. If my dataset has a 'Posting Date' as date/time field and how do I check if incremental refresh is actually working? In other word, we just want to refresh the data within incremental refresh window and the rest of the data should be historical.

      What is the easy way to monitor that?

      Thanks for your help.

      pthapa

       

    • Anonymous's avatar
      Anonymous
      Not applicable
      6 years ago

      Thanks v-xuding-msft , I'll give that a go. The table I'm working with (at the source) only has dates in string format - I convert these into date-time format in PBI. Will this still work in that case, or is there a way I can make it work despite the difference in formats?

      • v-xuding-msft's avatar
        v-xuding-msft
        Icon for Community Support rankCommunity Support
        6 years ago

        Hi Anonymous ,

        Sorry for late back. You could change the data type to Date. It will work. 

         

        Have you implemented it? If yes, please accept the helpful answer as a solution. More people will benefit here. If you have any questions, please feel free to ask.