I have done it. Use controller when in a vehicle and mouse + keyboard outside of it.
But what kind of computer does not have a keyboard connected to it? And wireless mouse/controllers are not much more expensive then wired ones.
Usb hubs aint expensive either. Actually both my keyboard and my monitor come with extra usb hubs build in.