I haven't encountered any adults who actually care about that in one-on-one conversations. I have however been excluded from group chats because mixing iMessage and SMS users resulted in a degraded experience. The iPhone users were, of course unwilling to consider installing any other chat app.
I find the last bit pretty annoying. It takes about 45 seconds to download Signal and confirm your number.