Unable to use the RLS security bucket to add anyone

A workaround that worked for our organization was to select "Test As Role" and then go back to the row level security. 

This worked when refreshing the page didn't.