2 Slicer Option Problem

I've tried to search for this, but can't find anything as the wording is difficult to make unique, so apologies. This will have been asked before, I just can't find it.

If I have a simple table like this:

I set up 2 slicers, the first is based on Building Name, the second on Department. The department slicer will dynamically change based on which building I choose from the Building slicer.

However, if I choose a department, then change Buildings, the incorrect department option will continue to be selected until I select something else. I.e. If I choose Building 1, choose Finance from the Department slicer, then choose Building 2 from the Building slicer, Finance will remain selected on the Department slicer until I choose another department.

It isn't report breaking, but it looks really unprofessional when all the visuals are either blank or are freaking out because they can't parse the data they've been given.

Is there any way to force the Department slicer to select a default option when the Building slicer changes?