Date table showing all values despite no data

Hi All, 

I have created a date table from this website using the code presented there, this gives me my date table, which I mark as "Date Table" in powerBI. Then I connect it to my current "AsOfDate" as shown below (Before connecting I have checked that both columns are formatted the same way):

Then I try to apply the date table in a slicer that I have, however this gives me all the dates as per below, despite that my data only have four data points:

Does anyone know how to solve this issue? 

Best Regards,
Solle