I've found Hetzner to be reasonable for VPSs and even bare metal servers, especially if you keep an eye on their auctions.

Whether you're hosting it all at home, all on a remote server, or some combination of the two, it's worth taking the time to first learn some form of automation tooling, so that your setup is reproducible and you know exactly how everything is set up. From the first time you have to rebuild everything due to a hardware failure trashing your server, or a careless rm -rf, you'll be glad of it.

Ansible is a good place to start as it's pretty straighforward to get going, and your playbook can grow with your requirements. If you're using a lot of containers, make sure you understand docker, and maybe consider Kubenetes, especially if you want to split your workload across servers.