Hiding nested rows with no data

Hi!
I am trying to create a matrix visual that has different kind of values and it offers option to expand the used rows. However, I wish that the rows with no data, would not offer option to be expanded. Is there any possibility to do this?

I'm attaching an example of what I'm trying to do.
This is the table I'm using:

And this is the matrix I have created:

My goal is to disable the option to disable the expansion of ''Group B'', because it doesn't have any subgroups.