Calendar visual using Matrix.

I am trying to create a visual in the form of a calendar with certain KPIs. For tthat I have 2 tables, one with my data and another calendar table which are correctly related.
When I try to drag the "Day number" parameter to values to create the calendar, the days of the month are not seen as it should.

In what is indicated in yellow I would like to see the day in corresponding numbers

I need something looking like this , but with all the numbers from the month  and only data in the ones I have something, if not just show blank.

How can I do? It only lets me see something close to correct when I use the day of the month field from the data table, not from my calendar table...

Table mapping

Thanks!!