After confirming that this is the behavior of the matrix design and that the matrix does not have Display unit "Auto", we checked almost a year's worth of Power BI Desktop releases and saw on the idea forums that there was a user request about this issue as early as 2020.
If you would like to suggest feature improvements, you may vote the idea and comment here Microsoft Idea to improve this feature. It is the right place for customers provide feedback about Microsoft Office products . What’s more, if a feedback is high voted there by other customers, it will be promising that Microsoft Product Team will take it into consideration when designing the next version in the future.
