His wife is still very attractive, but what if she wasn't? It wouldn't mean a goddamn thing, would it?
Beauty may be the reason why you are attracted to a person in the first place, but it's not at the top of the list of reasons why you stay with a person.
It's hard for me to even imagine being that shallow.