Dealerships are a reasonable middleman to exist. They provide a legal entity within the state, which is useful for resolving conflicts. They simplify logistics for manufacturers by having set places to deliver larger amounts of cars, and handle issue that arise from shipping more reliably than singular customers.

There are downsides to them, but none of them actually get better by removing dealerships and having people deal with GM or Toyota directly where there's even more power imbalance.