This is actually much worse for privacy than leaving everything stock, because a site can tell you aren't downloading or running any javascript, and that immediately puts you in an extremely tiny bucket of people it needs to differentiate from, making any differences visible via IP/TCP/TLS/HTML/CSS much more unique.
And yes, fingerprinting is possible with just HTML and/or CSS... I would argue even moreso without JS.