Also a LOT of those people had PTSD from wars or from lion attacks or from simply losing a massive amount of their offspring to illness and accidents. They raised your ancestors anyway.

This cycle has only recently been broken and not everywhere.