Find everything you need to get certified on Fabric—skills challenges, live sessions, exam prep, role guidance, and more.
Get startedGrow your Fabric skills and prepare for the DP-600 certification exam by completing the latest Microsoft Fabric challenge.
I know how to do incremental refresh for future date partitions in datasets semantic models.
However we now have a need to do the same for dataflows. How do I specify the "Effective Date" for dataflow incremental refresh?
Hey @lbendlin ,
In the Dataflow, I don't think that you can directly....however, I am just thinking out loud here....what about creating an "effective date" parameter (that is a datetime) and then use that as the the date field in the incremental refresh for the Dataflow???? Part of me thinks that would work great....and part of me thinks it will fail miserably but I am just thinking about it...
Proud to be a Datanaut!
Private message me for consulting or training needs.
It's a funny situation - our fiscal year 2024 has already started but incremental refresh doesn't know about fiscal years. So we can
- shift the partition date back a bit
- wait until Jan 1st for the problem to go away by itself
- use your idea with the parameter (for example as a delta to fool RangeStart and RangeEnd)
Or - as my colleagues suggested, sod it and create another dataflow for the "future" dates and then append the dataflows in Power Query.
Join the community in Stockholm for expert Microsoft Fabric learning including a very exciting keynote from Arun Ulag, Corporate Vice President, Azure Data.
Ask questions in Eventhouse and KQL, Eventstream, and Reflex.