Bar Graph that can Toggle between Absolute Variance and % Variance from Prior Year

I have built a dynamic slicer to toggle between Absolute Variance and % Variance from PY.

I have also built a toggle for WTD, MTD, QTD, and YTD.  

I have a separate measure for each so, I have ABS Var WTD, % Variance WTD, ABS VAR MTD, % Variance MTD, ETC.

I then used and If(and) statement to tell it what measure to use using SelectedValue combinations.

My problem is that the number is only capable of showing in one format.  I am not sure how to get it to show in % for Variance and decimal number for ABS VAriance.  You can't using the FORMAT command because it converts the number to text and then you can't place it on a bar chart in the Values area.  

Is there any way to do this or an easier way that I am not thinking about.  Thank you!!!