It probably depends on the person/couple. But if he were being emotionally intimate with the work colleague in a way he wasn't with his actual spouse that could be problematic.

If your wife/husband would love someone else, but didn't act on it, would you be fine with that? If not, then you understand emotionally cheating because that is why you don't like it.