Mines just learned how to ride a pedal bike without stablisers and taken to so well. Naturally that means he wants to always go somewhere on it! It is so great going on a bike ride together though.

Somebody who used to teach children how to ride gave me a tip which seemed to work very well. Hold them gently by the shoulder instead of lower down or the bike itself. This way they learn how to balance themselves.