In a matrix, how can I show only the variance greater than 80 at the total level?

[DJLight890]

I've created a mockup report that mimics my real data. I give this report to all Project Managers to view their workers Available monthly hours, project forecast hours, and the variance of the two. I want to be able to use a dax formul or the filters to show only the variance >= 80 at the total level which still keeping the data drill-downs.

Right now when I filter variance greater than or equal to 80, it only filters at the project level. I noticed when I take out 'Project' from the rows then the filter will work showing only those with variance >=80. However, the Project Managers would like to see the drill down on the same page rather than drilling through to other pages and I cannot seem to figure that out. 

Any help is appreciated! Here's a quick screenshot of my mockup data.

[DJLight890]

Any ideas?

I've tried IF statements in a DAX measure, but either it doesn't work or it ends up working the same as the filter which is only filtering on the project level. As mentioned, I'd like to keep the drill-downs, but have the filter work only at the top level total.