Restrict data shown in composite model

I am trying to creata a solution which I think many people/companies face.
We have a DWH and want to create Master semantic model for Self Service BI. A single source of the truth so we don't have to manage multiple semantic models when there are changes or extensions.

We have multiple teams who should be able to access the same tables, but data for team A (having their own workspace) should only be accessable from their workspace. The same goes for the other teams.
We have tried the following to implement this:
1) Created a Master semantic model in a restricted Workspace. Created a composite model in worspace Team A (based on the Master semantic model) and tried to restrict the data to just Team A. This failed because we see no option to restrict the data in the composite model just to Team A related data.
2) Implement RLS for the teams on Master semantic model. This fails because we have employees who are member of multiple teams. Also some employees have a contributer role so they can build reports. In that case for members who are member of multiple teams, data from other teams will bleed into the reports of Team A.

Any suggestions on how to implement this in a propper way?