Query on incremental refresh

[Anonymous]

Hi All,

My Database has one month of rolling data.Can I achieve to keep 3 months data in power bi by using incremental refresh ??

Regards,

Suman

[mwegener]

Hi @Anonymous,

yes, that should be possible.

Keep The Existing Data In Your Power BI Dataset And Add New Data To It Using Incremental Refresh https://blog.crossjoin.co.uk/category/incremental-refresh/

[Anonymous]

My data soruce having 1 month  of roling data. I have implemented the incremental refresh to store 3 month data and refresh data for 15 days. But during refresh its store 1month of the data only. unable to understand is anything I am missing.

[mwegener]

Hi @Anonymous,

do you use the Power BI service?

[Anonymous]

Yes , I am fetching data from log analytics where we have only one month of data.

[mwegener]

Hi @Anonymous,

can you share some screenshots?

[Anonymous]

[mwegener]

Hi @Anonymous ,

looks good to me. I would have now expected the amount of data to grow with every refresh in the Power BI Service.

[Anonymous]

But its not working as expected ..Can it be because the of the Soft delete or Hard delete in the source DB?

[mwegener]

Hi @Anonymous ,

the Detect data changes column should not be the same column used to partition the data.

https://docs.microsoft.com/en-us/power-bi/admin/service-premium-incremental-refresh#detect-data-changes

Take a look at this video.

Power BI Incremental Refresh - Understanding Detect Data Changes

https://www.youtube.com/watch?v=JsJWBr1_ktQ

[Anonymous]

The implementation was correct but there are different sets of reasons why it wasn't working. 
Thanks for your help.


Conclusion: Incremental refresh shouldn't be implemented if the data source doesn't support the foldable query feature.