They didn't use an acoustic coupler as in the image any more, you are correct ;-)
The noise was also still emitted by the more modern variants during dialing and connection establishment, and as I was reading the meme's text without paying much attention to the symbolic picture, I instantly thought of the standard 56k modem we still had.