Forum Discussion
Incremental dataset refresh
Hi PBILover,
Yes, power bi supports this case using the ‘Detect data changes’ option in Incremental Refresh. When this option is enabled, power bi tracks the maximum value of your selected change detection column for example like ModifiedDate for each partition. During the next refresh only those partitions where this value has changed will be refreshed and others will be skipped.
So in your case, if only 2 of the 5 partitions have updated records, only those 2 partitions will be refreshed. Make sure that ModifiedDate must be datetime not just date for accurate change detection.
If this post helps, then please consider Accepting as solution to help the other members find it more quickly, don't forget to give a "Kudos" – I’d truly appreciate it!
Thanks and regards,
Anjan Kumar Chippa
Correct me if i am wrong, i observed that it is not working as it is stated here, I observed all 5 partitions are getting refreshed.even though there are changes in only 2 partitions.
DO you have any scenarios on this?
Hi PBILover,
Looks like some conditions did not fully met, while power bi supports selective partition refresh using detect data changes, but it only works when a few key conditions are met:
- The query must fully support query folding all the way to the data source (in your case, Synapse).
- ModifiedDate must be a datetime column and used as both the range and change detection column.
- Partition specific refresh takes effect only after the first full refresh.
- This feature is supported only in Premium, PPU, or Fabric capacities but not in Pro.
If any of these are not met, power bi will default to refreshing all partitions in the incremental range.
To confirm I recommend checking query folding, you can use the refresh history and verify which partitions were actually refreshed.
If this post helps, then please consider Accepting as solution to help the other members find it more quickly, don't forget to give a "Kudos" – I’d truly appreciate it!
Thanks and regards,
Anjan Kumar Chippa
I agree with you
Hi PBILover,
Thank you for confirming that all the required conditions are met. Since you are still seeing all partitions being refreshed, I recommend you to please raise a Microsoft support ticket so that they can analyze the backend telemetry and logs and investigate further.
How to create a Fabric and Power BI Support ticket - Power BI | Microsoft Learn
Thanks and regards,
Anjan Kumar Chippa
Sure, Thank you
