Ding ding ding. You're 100% right that the people saying this aren't socially competent.

Either they can't socialize normally, or they are using this as a smoke screen to justify being pervy. Or both. Probably both.