It probably depends on the person/couple. But if he were being emotionally intimate with the work colleague in a way he wasn't with his actual spouse that could be problematic.