Forum Discussion
Incremental Refresh is slower than a normal refresh...
I set up incremental refresh on a dataset with about 3million records. I set the incremental refresh to work on 1 of the 18 months in the dataset. Everything works, but it actually takes longer to ...
Hi there
If you are getting the data from a database source, could you possibly run Query Profiler and see what query is being sent to the source?
Also if my entire dataset was refreshing in 3 minutes and the requirement was to only refresh daily then I would leave it as is. No point trying to fix something that is working pretty quick.
If you are getting the data from a database source, could you possibly run Query Profiler and see what query is being sent to the source?
Also if my entire dataset was refreshing in 3 minutes and the requirement was to only refresh daily then I would leave it as is. No point trying to fix something that is working pretty quick.
I hear you on the 3 minute refresh. I was eager to use this to save some time. It's a big feature that I've been waiting a long time for. There's always a more efficient solution. I've got 100's of users using datasets, so I hate tying up the back end of the Vertipaq engine with reloading millions of stale data, potentially impacting performance. It seems inefficient on both a system resource and time perspective.
Whatever the driver, it's extremely odd that incremental is slower than the full refresh. Seems like total non-sense to me. hopefully it's a bug that they'll address before making it GA in Premium. I personally find it Disapointing. I'm glad it helps out people running massive datasets though.
- Hi there
The reason that it possibly takes longer is due to the fact that in order to complete an incremental refresh there are other things happening in order to make this happen, such as moving current partitions, processing previous partitions if they need to be merged, creating new partitions and then processing new partitions.
All of this takes time, and incremental refresh since its inception in SSAS Multi-Dimensional has always been intended for larger datasets. And in my experience if something is taking less than 5 minutes to do a full process the time and effort involved to make this change is not worth it.