Forum Discussion
Incremental dataset refresh
PBILover Thank you for the response, do you need any other assistance from us. If any of the responses were helpful please mark that response as Accept as Solution or please provide any useful insights and accept your own post as solution, so that other community members will find it more easily.
Thanks and regards,
Anjan Kumar Chippa
Sure, I want to achieve only the partition which updated modified date should get refreshed. Is it possible to acieve this in any way? lets say in detect data changes there are 5 partitions out of which only 2 have changes in it. Power BI refresh all the 5 partitions, but i want to refresh only those 2 partitions.
Hi PBILover,
Yes, power bi supports this case using the ‘Detect data changes’ option in Incremental Refresh. When this option is enabled, power bi tracks the maximum value of your selected change detection column for example like ModifiedDate for each partition. During the next refresh only those partitions where this value has changed will be refreshed and others will be skipped.
So in your case, if only 2 of the 5 partitions have updated records, only those 2 partitions will be refreshed. Make sure that ModifiedDate must be datetime not just date for accurate change detection.
If this post helps, then please consider Accepting as solution to help the other members find it more quickly, don't forget to give a "Kudos" – I’d truly appreciate it!
Thanks and regards,
Anjan Kumar Chippa
Correct me if i am wrong, i observed that it is not working as it is stated here, I observed all 5 partitions are getting refreshed.even though there are changes in only 2 partitions.
DO you have any scenarios on this?
Hi PBILover,
Looks like some conditions did not fully met, while power bi supports selective partition refresh using detect data changes, but it only works when a few key conditions are met:
- The query must fully support query folding all the way to the data source (in your case, Synapse).
- ModifiedDate must be a datetime column and used as both the range and change detection column.
- Partition specific refresh takes effect only after the first full refresh.
- This feature is supported only in Premium, PPU, or Fabric capacities but not in Pro.
If any of these are not met, power bi will default to refreshing all partitions in the incremental range.
To confirm I recommend checking query folding, you can use the refresh history and verify which partitions were actually refreshed.
If this post helps, then please consider Accepting as solution to help the other members find it more quickly, don't forget to give a "Kudos" – I’d truly appreciate it!
Thanks and regards,
Anjan Kumar Chippa