I'm not coming at you with hostility, I am informing you that what you are saying is incorrect. If you keep on skimming over everything I say, then perhaps I may get hostile because that is extremely annoying.
If you are so sure of yourself on the kernel driver front, then do me a favor and fire up gentoo or arch and try to run a desktop environment or window manager without the mesa packages installed. You'll find that xorg has mesa as a dependency, and there's a very good reason for that: it's because that's not what the kernel driver is for, mesa itself is larger than the kernel itself. The kernel driver is exactly what I said it is, it allows the operating system to see and interact with the device, it doesn't tell the device how to do its job, it tells it "here are some pipes, you will receive information from certain ones, and send it through others". That's exactly what a kernel driver does, there are no libraries or anything of that nature which is the overwhelming bulk of what makes a graphics driver.
Also, geforce now is optional, you can as always install the drivers without the useless spyware application that nvidia provides.