Security for SSAS live connection not working

I've found an issue in PBI desktop with a live SSAS MD cube connection.

In SSAS we have security roles restricting access to certain measures for different roles. These roles work fine, and when accessing the cube via live connection from PBI desktop from a restricted user, the measures don't show up. So far so good.

If I change an ssas role and add one of the missing measures to a user, it also pops up from PBI for that user.

However, if I change that role and remove the measure again, the measure still remains visible from PBI.

I've double checked the role, and if I connect to the cube via Excel the measure is NOT visible for the user anymore.

But from PBI desktop, even if I create a new live connection from PBI against the same cube, the measure is still there, and shows values. It's like the access to the measure is cached somehow.

Is this something anyone else has noticed? Is this a bug or is there a setting in PBI that I need to change somehow? I've tried clearing the cache from within PBI desktop but that doesn't help either. It's still visible.

This is a pretty serious issue, for us at least. If only granting access to measures in ssas take effect in PBI, but not revoking access.

Do we have anyone out there who knows anything about this, or could test it and see if it applies to you too?

We're on SQL 2014 Enterprise if that's any help.

Thanks in advance!