I use Launch Chat for the occasional use. You can paste the number there and press a button to open whatsapp dms for given number. Been using it for a very long time without contacts access and never faced an issue, installed from fdroid repo.