There's really no need for a KVM switch, I think having two physical computers to deal with in my case would just complicate things. Running the VM for my work life during work hours and then shutting it down once I'm off the clock is super simple already.

As far as GPU partitioning, all of the clients I work with are spending their day working with things like Excel and Outlook, so nothing graphically demanding.