RLS for Manager and Next Level Manager

Hello,

I have a data set where we have a Level 1 leader who is called Senior Leader and Level 2 Leader who is a Manager. I have put up RLS in my dataset where the Level 1 leader is able to see his data set (roll up of all Managers under him) and Level 2 leaders are able to see their data. 

when the Level 1 leader tried to filter the data via a slicer for his individual Level 2 leader, the data does not filter. It still shows him the consolidation for the complete group. 

how can I make that work. What am I doing wrong for that to not work.