Dataflow Gen2 incremental refresh alternative to modified date

Hi PowerBITestingG ,
Thanks for posting in the Microsoft Fabric Community.

Your approach works well when there is no modified date to use for incremental refresh. The filters you mentioned for separating historical and recent data are a good way to avoid duplicates, and the union view in the warehouse can combine them.

If your source can have late-arriving records, you can keep a small overlap in the date ranges and then remove any duplicates in the union view using a unique key.

Thanks for sharing here as this helps others in the community, and please reach out for any further assistance.

Problem: No “modified date” → Gen2 incremental refresh can’t detect changes.

Your approach (historical flow weekly + recent flow hourly + union in warehouse) is a common partitioning strategy when incremental keys are missing.

Key considerations:

Make sure both flows use mutually exclusive filters (<90 days vs ≥90 days) to prevent duplicates.

Test for late-arriving records (data older than 90 days that may still update). If that happens, adjust the cutoff window.

Monitor performance of the hourly flow; keep recent partition as narrow as possible.

Overall: Good pattern until source provides a change-tracking field.