With skiing you're at least a bit in control of how much risk you're taking, with possibilities for very low risk fun. With horses, yeah if you get hit in the head or fall the potential for very bad injuries is always there.

And yeah I know that some people manage to fuck themselves up badly on green slopes but still I personally always felt pretty safe while skiing because I'm a pussy and make sure I never ski above my level.