Forum Discussion
Dataflow Incremental Refresh on integer datetime, no GUI option available
I was able to get around this issue.
1) Load your data into the dataflow
2) Create a dummy datetime column. This will break query folding for now but that's okay
3) Save and close the dataflow. Set up your incremental refresh policy using the dummy.
4) Go back into the dataflow. Delete your dummy variable and set up the incremental refresh with the integer column. Query folding should start working again
I was able to get around this issue.
1) Load your data into the dataflow
2) Create a dummy datetime column. This will break query folding for now but that's okay
3) Save and close the dataflow. Set up your incremental refresh policy using the dummy.
4) Go back into the dataflow. Delete your dummy variable and set up the incremental refresh with the integer column. Query folding should start working again
This is actually what I was working on, with a couple extra steps necessary to get it all flowing right. Namely, don't delete the dummy column -- instead, after enabling incremental refresh go back and redefine the dummy column to be 1 minute ahead of RangeStart. This will then fold, and will partition correctly as well, as the incremental refresh feature does use the datetime value to determine partitions I believe.
