Metric Hierarchies not working

I created a scorecard with a dataset from SSAS, I then created Hierarchies (metric hierarchies ) successfully (could see the hierarchy in the preview hierarchy pane). However when I return to the scorecard and click on the "ALL" dropdown to choose one of the hierachies I've created, all I see is the word"All" with a checkbox next to it in the dropwdown, not any of the hierarchies I created. As I said I'm using a SSAS dataset for the metric and the hierchies, not sure if there is some limitation with SSAS datasets and the metrics heirchies preview? What could be causing this?