One user in multiple roles causing row level security to stop applying

I will try my best to describe the issue I am having. I have several roles against several tables. When only one user is assigned to a single role, everything works fine, but soon as one user is assigned to multiple roles, row level security stops working. For example, I have the following roles, Director, Team Leader, User. If I add User A to both the Team Leader role and User role in the Power BI service, row level security stops to work. However, if I assign them to only one of those roles, it works as expected. I was expecting that whichever role provides the higher level of access would take precedence not that row level would stop working. Of course, the appropriate thing would be to only assign them to one role but access is being managed by AD groups and by 1st line support. My worry is that, if they accidentally assign the user to multiple roles, row level security stops working and the user sees sensitive data they should not be able to see. Is this a problem or am I doing something wrong? There is a reason why we are doing in the way shown in the screenshots below. The traditional hierarchy doesn't work for our business due to various reasons.