Dynamic Format String (preview) - not working in a report live connected to dataset

The new preview feature of dynamic format strings for measures only appears to work if the measure is created within the Power BI dataset. It will not work if I create a measure in a report which is...