Hiding the slicer visual in Power BI based on the RLS

Hi, 

I'm trying to find a way to hide one of the slicer visual based on the Row Level Security. Currently the RLS work for the report to show data pertaining to the username.

I'd would now like to add another filter slicer but for this filter to only show if they are not in my RLS table. Is this possible? The Hide Card measure doesn't work as it will only hide the filter or make it transparent based on the measure value. I still would want the user to be able to interact with the visual, but with the card on top of the filter, this isn't possible

Any suggestions would be great. 

Thanks