Not enough gravity, the atmosphere will drift away from the planet with the help of solar winds etc. Too much gravity, and the ammount of fuel you need to leave the plannet weighs more than the rocket the fuel is being used to lift can carry.

Even in our current ships, most of the fuel used to leave orbit is really used to carry the other fuel you need later.