It's a different trade-off. Most routers, both cheap and expensive, are designed to deliver data to multiple devices. To do this, they need to switch who is getting data delivered at any given moment.

VR headset video is incredibly unforgiving for this. It's high bandwidth, but requires incredibly low latency to not me nausea inducing. Its also limited in the tricks it can use to hide lag, like online gaming does. Any disruption to the data stream will be noticeable.

It's akin to the difference between a waiter handing out glasses of water, Vs aiming a firehose at your face and letting rip.