Hide/Show matrix, or rows in matrix based on conditional filter

Hello Power BI Community,

I need your help with this one. I have a report with some visuals that are filtered by a condition where a user should/sloudn't see the results based by the number of people in their team who completed a survey. Now, this filter works on any other visual, except on a matrix. The user is able to read the matrix rows even though the other visuals values are not shown. That matrix contains the comments of the people that have responded to that survey and the comment is shown by expanding [+] two rows. So I can't really do the magic trick to hide the whole matrix with another visual on top because the users for whom the filter doesn't apply still need to expand the rows.

I've run out of the ideas on how to approach this. 

Thanks!