The R36s is pretty affordable if I remember correctly

Or, if you have a soldering iron and are into DIY, you can make a retro handheld console with an Arduino or a Raspberry Pi.

You can also 3D print the case and buttons (if you don't have a printer, check if your local library does).