It only lasts for one character, it works on all characters (for instance Caps Lock won't change a "2" India an "@"), and it also works for other modifier keys like "Ctrl" and "Alt."

It's an accessibility feature. If you only have 1 hand, for instance, some shortcuts would be impossible without it.