How do you have HA set up? For example I currently have a Raspberry Pi 4 and installed a HomeAssistant Docker image.
Since I'm not using HA addons, I'm free to use any Docker image that supports Raspberry Pi's ARM architecture. I use a simple file server which is more than enough for my needs.
If you're using an HA setup where that's not possible, someone else may be able to suggest an HA addon that would fit your needs.