Removing App permissions does not remove permissions to underlying data

I have a concerning issue.   I’ve been going through and culling the list of people who have access to my published PBI application.  However, when I remove people from the app I get a pop-up that ...