RLS column security

Hello fellow Power BI developers,

I have a challenge which I cannot find a suitable solution for.

We have a situation in which we woud like to restrict users to see the content of a specific column in a (dimension) table.

For example: The users can see all the information in the customer table, except for the customername. The users can only see the costumername for the customers they are responsible for.

So its basicly a combination of RLS with object level security.

I tried a lot of thinks but I cannot get it to work. I got it to work by making a measure, but having a measure instead of a label is not a suitable solution.

I am working with a SSAS Tabular model.

Any advice?

Regards