To where did you measure the ping? With such a low latency, it almost sounds like a speedtest within your providers network, which can differ a lot from real world experience on game servers outside your providers network.
Even dns.google and one.one.one.one give me about 5ms advantage to any game server.
I run OPNsense on a Sophos SG 230 with some upgrades and deployed a Sophos SG 135 running OPNsense at my dads house last weekend.
Edit: without Zenarmor, the Sophos SG 135 can easily push > 1 GBit/s across networks.
Haven't looked into Vyos yet.