The Bene Gesserit had been secretly selectively breeding the noble houses for dozens of generations by the time of the books. Strength and athleticism were two of the factors they bred for. It might not have been as bad as you think...