When Cross Filter is Off, Chart Should Not Be Clickable

Currently when you turn off Edit Interactions for an object such as a column or bar chart, that chart will of course stop filtering any other items on the canvas. However when you click on one of the bars or columns, you can still select the item. But it doesn't do anything. This is confusing to users of the report. The all the cross filtering is turned off for an object, the chart should not be clickable like a chart that does cross filter.