Show/Hide a visual with IsFiltered condition

Hi there. 

I need to show or hide a visual according to the state of a measure: If the measure is filtered, then show the visual. If not, hide it.

Actually, I use a rectangle with text and fill formatted with the IsFiltered function. And it works fine.

The problem is that if I need to drill down the visual in my web dashboard, well I can't, because the rectangle is on a upper level, so i'm clicking always the rectangle and not the visual.  

Any idea to hide or show the visual without this trick, using the IsFiltered condition? If I was on PowerApps, I'd use the Visible property of my visual, but here this trick doesn't work.

Please, don't tell me to use buttons. I simply don't want to see buttons to hide/show something in my dashboards. 

Thankyou!