I think most people's resentment for sports, if you asked them, comes from their connection to gender norms, and how kids who aren't interested in sports are treated by society as freaks who need to be policed into liking the appropriate gender coded activities. I suppose that also extends to people who for whatever reason weren't fortunate to be good enough at sports that they were picked last.

Either way the issue isn't that they werent good at it or weren't interested - its the gendered stigmatization that comes with it.

Perhaps that's changed or isn't as extreme now as it was. But, most peoples issue that grew up when i did comes from the reaction from society at large for not liking the enforced gender coded thing and being told whatever we liked instead was stupid or wrong and that we needed/were expected to like sports instead.