Forum Discussion

BrentonC's avatar
BrentonC
Helper I
6 years ago
Solved

DataView Array maximum 100?

Hello, 

 

I am having a go at creating a custom visual, it all seems to be going okay although in one of my tables I have 300+ rows of data. When looking at the array in the data view array it always only reaches 100, I have tried a few different things and wasted some hours.
An example of the code broken down. 

 

 

 

public update(options: VisualUpdateOptions) {

let dataView_: DataView = options.dataViews[0];

for (var j = 0; j < dataView_.table.rows.length; j++) {
console.log(j)
}

 

 

 

 

Thank You

Brenton Collins

Need Help
  • dm-p's avatar
    dm-p
    6 years ago

    Hi BrentonC, and thanks for confirming 🙂

    From reviewing your capabilities, there are two issues and have pasted a working version underneath.

    1. You have three different dataViewMappings defined.
      • The SDK only supports one.
      • As your're referencing table in your visual's update method in the OP, I have removed the others.
      • Note that with issue #2 resolved, this still causes the 100 row limit (presumably due to conflicting mappings in the dataView allocating more data points than actually needed).
    2. The table dataViewMapping is referencing a non-existent dataRole named Rows (the matrix was similarly set up).
      • This was somehow getting the right data field but caps the generated dataView at 100 records.
      • For the data to be mapped correctly into the dataView you need to reference the defined dataRoles.
      • Based on your dataRoles, the rows object should map to category1.

    Here's a working version of your capabilities - this works for the default maximum of 1,000 data points:

    {
    "dataRoles": [
        {
            "displayName": "CCFV",
            "name": "category1",
            "kind": "Grouping"
        }
    ],
    "dataViewMappings": [
        {
            "conditions": [
                {
                    "category1": {
                        "max": 1
                    }
                }
            ],
            "table": {
                "rows": {
                    "for": {
                        "in": "category1"
                    }
                }
            }
        }
    ]
}

     

    Confirming output from my console (last value is 999, as for loop is indexed from 0):

    Hopefully that's all you need to get moving. Good luck!

    Daniel

5 Replies

  • dm-p's avatar
    dm-p
    Super User
    6 years ago

    Hi BrentonC,

    WIthout seeing your capabilites.json I'd first suggest checking the data reduction algorithm. The doc says that there's a limit of 1,000 data points by default but if you have 10 categories x 100 rows then this will likely be your issue. Setting this limit appropriately should get you to where you need to be.

    If not, would you be able to share your capabilites.json file contents here, so we can see how your dataView is being built? This can help with the next stage of diagnosis if we need to go further.

    Thanks,

    Daniel

    • BrentonC's avatar
      BrentonC
      Helper I
      6 years ago

      Thank you for the reply, 

      I did originally have 10+ columns, although I changed the format fo the data and now there are just 3 columns.

       

       

      {  
    "dataRoles":[
        {
            "displayName": "CCFV",
            "name": "category1",
            "kind": "Grouping"
        }
     
    ],
    "dataViewMappings": [
        {
            
            "conditions": [
                {
   
                    "category1": {
                        "max": 1
                    }}
            ],
            
            "table": {
                "rows": {
                    "for": {
                        "in": "Rows"
                    }}
            },
            
            "matrix": {
                "rows": {
                    "for": { "in": "Rows" }
                },
                "columns": {
                    "for": { "in": "Columns" }
                },
                "values": {
                    "for": { "in": "Values" }
                }
            },
            "categorical": {
              
                "values": {
                    
                    "select": [
                        { "bind": { "to": "category1" } }
                     
                    ]
                }
            }
        }
    ]}

       

       

      Before and after adding in the data reduction algorithm I am still receiving the same result.

       

       

      Structure to the dataset

       

       

      Thank You

      Brenton

      • dm-p's avatar
        dm-p
        Super User
        6 years ago

        Hi BrentonC, and thanks for confirming 🙂

        From reviewing your capabilities, there are two issues and have pasted a working version underneath.

        1. You have three different dataViewMappings defined.
          • The SDK only supports one.
          • As your're referencing table in your visual's update method in the OP, I have removed the others.
          • Note that with issue #2 resolved, this still causes the 100 row limit (presumably due to conflicting mappings in the dataView allocating more data points than actually needed).
        2. The table dataViewMapping is referencing a non-existent dataRole named Rows (the matrix was similarly set up).
          • This was somehow getting the right data field but caps the generated dataView at 100 records.
          • For the data to be mapped correctly into the dataView you need to reference the defined dataRoles.
          • Based on your dataRoles, the rows object should map to category1.

        Here's a working version of your capabilities - this works for the default maximum of 1,000 data points:

        {
    "dataRoles": [
        {
            "displayName": "CCFV",
            "name": "category1",
            "kind": "Grouping"
        }
    ],
    "dataViewMappings": [
        {
            "conditions": [
                {
                    "category1": {
                        "max": 1
                    }
                }
            ],
            "table": {
                "rows": {
                    "for": {
                        "in": "category1"
                    }
                }
            }
        }
    ]
}

         

        Confirming output from my console (last value is 999, as for loop is indexed from 0):

        Hopefully that's all you need to get moving. Good luck!

        Daniel