Forum Discussion
Developing a custom visual but not getting all the rows in the dataset
Hi angelflight,
The dataReductionAlgorithm has a max value of 30,000, even (if you want to use the window algorithm with fetchMoreData) and will likely be reverting to the default of 1,000 as the value is out of range.
I'm not near my dev machine to validate this suggestion for you but I would start by setting this to 30K or lower and seeing if this gets you over 1,000 rows. In the case of using window, the 30K limit still applies for this but the presence of the segment property in your dataView can then be used to load in the additional data.
If this doesn't work for you, let me know and I'll see if I can provide you with a valid configuration when I can get back to my dev machine (likely tomorrow), but I'm hoping that's all you need to get this working.
Good luck!
Daniel
EDIT: completely forgot I made this repo a while ago to demo this exact situation, even down to using the table dataViewMapping... you hopefully might find it useful
Thank you so much for your response. I had actually already found your repo and had integrated that code, but since there are no segments in the metadata object, it doesn't do the fetch. I tried removing the check to see if the segments exist:
if (options.dataViews[0].metadata.segment) {
When I do that, this.host.fetchMoreData() evaluates to true, but I still only get 1,000 rows.
What's weird is that I only have 18,100 rows. I have tried setting the dataReductionAlgorithm count to 20,000 and also to 100,000 and then, based on your suggestion, to 6,000 to see if it will force the creation of the segments, but it does not.
Any additional thoughts you may have would be appreciated.
- ThibaudGD4 years agoFrequent Visitor
Have you found the solution ? Because I'm facing the same issue