Sort matrix descending

I have a matrix that has date hierarchy rows of year, quarter then date:

I'd like to sort by date descending with the most recent on top.  I can't do that.  The best I can do is sort descending by year but then quarter and date are in ascending order.  Does anyone know how to do this?  It's driving me crazy. 

Edit: It seems like I made the date descending with a rank column but I don't see any way to do it to quarter.  A rank column doesn't work.