This is exactly the problem. "Supporting policies that make things worse for the average person" is not the same thing as "accelerationism." Some people are just wrong, or they have different motivations (like making them and their friends rich). If accelerationism just means making things worse, then everyone is an accelerationist to everyone who disagrees with them, it loses any real meaning.
There may be a handful of actual accelerationists in the party, but they're mostly driven by material interests and a whole bunch of brainworms, not by some accelerationist strategy.