Dynamic formatting using calculationg groups incorrectly applies formatting to other visuals

I have a calculation group that is set to:

SELECTEDMEASURE()

with a format string of:

 IF ( SELECTEDVALUE ( 'MSR_EMEAMeasures'[Currency] ), SELECTEDVALUE ( 'Dimension Currency'[Symbol] ), "" ) & SELECTEDVALUE ( 'MSR_EMEAMeasures'[PBIFormat] )

When I interact (click a bar) with the Chart the Matrix inherits the format string of the Chart, is there any way of preventing this?

It should look like this (formatted correctly):

Note:

Both the Matrix and the Chart reference separate tables with the same list of KPIs: