Cross-Field Buttons - is it possible?

Hello all, I am currently working on a Power BI dashboard, and have ran into a snag in the road that I am hoping can be answered here. 

In this data set, I have 3 years of data, with Actuals and Planned (called RateMake) activity for all years. I have implemented a field called 'YearType' to quickly be able to filter on different years/types (I.E. I can look at 2021 Actuals, 2022 Plan, 2023 Actuals; etc). However, I have not been able to figure out a way to have a data label that shows whether each year is Actual/Plan. From my understanding, the label/button will only show the year of the chunk chart column.

Does anyone know if it is possible to add a button that will react based off of a the slicer in the top right?