There should be an a audio focused distro. I think one way to solve this problem - it's been am minute - is to host VSTs on a network node and access them over the network.
This takes a bit of doing and dedication but that is one approach.
It's pretty exotic and not your use case...but for some it works well.