Forum Discussion
Incremental refresh using datetime
Hello
we have a dataset whereby the rows contained a datetime field.
But because of the high cardinality we splitted this in a date and a time field.
We have to refresh this data on a daily basis. But for that we need a datetime field.
But then we create again the isssue of the high cardinality.
In the table we also have a day-key.
Do you always need a datetime field to do a refresh?
How to solve this problem?
Regards
Ron
Yes. That was your goal, to keep the cardinality low, right?
9 Replies
- lbendlinSuper User
Your RangeStart and RangeEnd parameters need to be DateTime, and they need to be used in the Power Query filter for the query/table that you want to implement incremental refresh for.
But it doesn't really matter what they compare to. So you could write a filter that says
DateValue+TimeValue > RangeStart and DateValue+TimeValue <= RangeEnd
- AnonymousNot applicable
Ok, so you then keep the date and time field as separate fields? Also when comparing to RangeStart and RangeEnd>
- lbendlinSuper User
Yes. That was your goal, to keep the cardinality low, right?
- AnonymousNot applicable
lbendlin one more question. It is not possible to use just a Date field (so not a Datetime field) for RangeStart and RangeEnd?
regards
Ron - AnonymousNot applicable
Hmm, how does the casting work lbendlin ?
Not yet so experienced in Power Query and refresh