Fuzzy Match addresses by Grouping

.Dear all,

I have 2 data tables , both have the Contact Name and Addresses. (Street, Number, district, ward, province)

However after fuzzy match by address (threshold = 0.9) , there are still many unmatched records,

the District, Ward, Province  are well formatted , only the "Addresses" are not well recorded 

I would like to narrow down to fuzzy match by the "Contact Name" 

for example : match the contact name only within "district/ward/province" 

Is there a way to Fuzzy match while filtering multiple columns?