Finding first date in table where column changes value

I have a table with a date column and a number column.

Example:

I want to add a calculated column that returns the first date where the number is different than the current row.

I've tried using the following DAX formula:

Column =
 CALCULATE(
     MIN('Table'[Date].[Date]),
     FILTER('Table', 'Table'[Date].[Date] > EARLIER('Table'[Date].[Date])),
     FILTER('Table', 'Table'[Number] <> EARLIER('Table'[Number]))
)

As well as:

 CALCULATE(
     MIN('Table'[Date].[Date]),
     FILTER('Table', 'Table'[Date].[Date] > EARLIER('Table'[Date].[Date])
     && 'Table'[Number] <> EARLIER('Table'[Number]))
)

But this only returns the first date after the current date:

And the result I'm looking for is:

Somehow it feels like the second filter in the formula is being ignored.

Any help on how to accomplish this would be greatly appreciated.