It is also inconvenient in many other ways, because Meta makes it intentionally annoying to use WhatsApp without contact permissions 🤷
And no, your carrier does not have access to your phone's contact list. There is a lot more privacy relevant details in it than pure calling information.