You could read a bit about NAT, which your router does, if you want to know more. But yes, of course only the initiation requires an open port, otherwise like you said, it doesn't make sense. As soon as a connection is established your router knows where packets should be sent and an "open" port is not necessary.