Every decision made about the vision pro was idiotic. They didn't even have a developer kit so you had to buy the full price to device and you didn't even get developer options for your trouble so no one developed for it. It wasn't available outside of North America, it didn't have a controller so interactions were clunky, it didn't support gaming which is basically what a VR headset is for, it would only interact with an MacBook making the effective price even higher, it was uncomfortable, the battery was a randomly a separate part to absolutely zero customer benefit as it wasn't hot swappable, after the big swanky launch event Apple proceeded to completely forget about it and didn't release any updates, and as you say they never made an affordable version.
Literally every other VR headset was a superior option, and apples attempt to rebrand the product as "spatial computing" just confused everyone.