Some routers do support it.
- OpenWrt: enable SQM (cake + piece_of_cake.qos)
- Ubiquiti: enable Smart Queue
- FritzBox: limited but has prioritization
- OPNsense/pfSense: fq_codel / CAKE
would be even betyer cause it shapes the entire network, not just your PC
but apparently you can also install cake on any linux and use it to do what you want:
https://man7.org/linux/man-pages/man8/tc-cake.8.html
https://github.com/tohojo/sqm-scripts
good readup about cake but not focused on your usecase: https://grapheneos.org/articles/server-traffic-shaping
I have no clue about bazzite, so you are on your own there.