Unable to hide Visual Level Filters from "New Filter Experience"

Looking at this in the new April update on desktop, it looks like with the move to the new filter pane (and the removal of the old filter view) all of the visual level filter fields seem to have been turned to "visible" even if they were not previously.

EDIT - Ignore this. I just did a test run on desktop, April update, hiding visual level fields in the new filter pane and they still seem to be visible when published to service.