The slowing down is a function of conductivity. Electromagnetism means the magnet induces current resulting in magnetism pushing back. Ferromagnetism on the other hand is a somewhat rare property of some metals where all of their atoms can be pushed into the same magnetic orientation.

Disclaimer I'm an engineer half remembering this stuff