Forum Discussion
What is the function of Detect Data Changes in Refresh?
- 4 years ago
Hi, Anonymous
Please refer to Incremental refresh and real-time data for datasets .
The Detect data changes setting enables even more selective refresh. You can select a date/time column used to identify and refresh only those days where the data has changed. This assumes such a column exists in the data source, which is typically for auditing purposes. This should not be the same column used to partition the data with the RangeStart and RangeEnd parameters. The maximum value of this column is evaluated for each of the periods in the incremental range. If it hasn't changed since the last refresh, there's no need to refresh the period. In this example, this could potentially further reduce the days incrementally refreshed from 3 to 1.
Related tutorial:
Power BI Incremental Refresh - Understanding Detect Data Changes
Best Regards,
Community Support Team _ Eason
Hey Anonymous ,
the idea behind this column is that you have an additional column in your SQL Server like a "Change Date" or a "Load Date". This is quite common in a data warehouse to maintain the data load to the data warehouse.
Like this Power BI can only monitor the "Load Date" column and load the rows that are changing in the source. For more information check the description in the documentation:
https://docs.microsoft.com/en-us/power-bi/connect-data/incremental-refresh-overview#optional-settings
If you need any help please let me know.
If I answered your question I would be happy if you could mark my post as a solution ✔️ and give it a thumbs up 👍
Best regards
Denis
Blog: WhatTheFact.bi
Follow me: twitter.com/DenSelimovic
Hi
I understand, We have a creation datetime, which I use for the incremental refresh RangeStart RangeEnd, and we have a last change datetime, which I use for Detect Data Change. But If you look at my test's, why doesn't it do what I expected?
- v-easonf-msft4 years ago
Community Support
Hi, Anonymous
Please refer to Incremental refresh and real-time data for datasets .
The Detect data changes setting enables even more selective refresh. You can select a date/time column used to identify and refresh only those days where the data has changed. This assumes such a column exists in the data source, which is typically for auditing purposes. This should not be the same column used to partition the data with the RangeStart and RangeEnd parameters. The maximum value of this column is evaluated for each of the periods in the incremental range. If it hasn't changed since the last refresh, there's no need to refresh the period. In this example, this could potentially further reduce the days incrementally refreshed from 3 to 1.
Related tutorial:
Power BI Incremental Refresh - Understanding Detect Data Changes
Best Regards,
Community Support Team _ Eason