There's no "actual homophobes" vs " not homophobic but still unhappy that queer people and 'forced inclusion' are in a game people"
That's the same kind of argument as saying criticizing Israeli genocide is antisemitism. There are objectively bad things done in the name of inclusion. Criticizing them is not homophobic. If you are going to pretend they are, that you are somehow above criticism just because your stated goal is noble, don't be surprised when people turn against you.