During the Civil War we were less than half our current size. Maybe even a third the size. I can find maps that show our size but none that actual say what our land area was. I could calculate it, but I'm not. Also, we had about 10% of our current population.
So yea, we were quite a bit smaller back then.