That's completely wrong. Many states moved their capital away from population centers on the coast into more geographically central locations inland. Other states deliberately planned their capitals to be in central locations when it was already clear where the population centers were going to be.
If anything the capital city only grows and becomes the population center. Population never drifts away from the capital.