Visualize by Month and Week Number

Here's a fun one - created a Dax calendar using CALENDARAUTO(12)

Added a column using: Month = FORMAT(DatesDAX[Date], "MMMM")

Added a column using: WeekNum = WEEKNUM('DatesDAX'[Date].[Date])

Put them into a hierarcy to get the following visual:

The only issue is that because the week numbers exist in both months - it's doubling the data for those crossover weeks(27,31,36).

Any ideas how I can clean this up?

Thank you!