Aggregations limitations

It seems I've run into one of the limitations of the Aggregations feature. I have many calendar role playing dimensions. I'd like to consolidate them into a single calendar table and use a slicer and DAX (USERELATIONSHIP function) to allow users to decide which role the generic dates in the single calendar table should play. I don't want to create multiple versions of each measure for each type of date role.

Anyway, when I do this using the Aggregation feature I find that because of the USERELATIONSHIP function the measures are not hitting the aggregation and are instead running slower DirectQuery operations.

So my question is whether anyone has ever figured a workaround to the USERELATIONSHIP limitation of the Aggregations feature?

Or are there other reasonable and creative solutions to consolidate role playing dimensions while maintaining the benefits of the Aggregations feature?