OS matters, linux is probably the most efficient. The distribution matters less. But it also depends on what you want to do. Use it as a desktop?

As others have said, disable services you don't need, close programs you aren't using.

Actually that does make me think, there might be distros that automatically clean up unused programs and turn down the frequency of the CPU when it's not in use. Haven't done a thorough search though.