I've never heard that advice and the only people I've ever known to carry it were white children

It's useful when you're opening a bank account but social security cards don't have photos so cops don't care. If you have a photo ID, the card is useless. If you only have the card, that's useless, too.