I read this book a while back that makes an argument about this Is the same with houses of the wealthy: they are all white with muted greys, almost like an art gallery.
Chromophobia manifests itself in the many and varied attempts to purge colour from culture, to devalue colour, to diminish its significance, to deny its complexity. More specifically: this purging of colour is usually accomplished in one of two ways. In the first, colour is made out to be the property of some ‘foreign’ body - usually the feminine, the oriental, the primitive, the infantile, the vulgar, the queer or the pathological. In the second, colour is relegated to the realm of the superficial, the supplementary, the inessential or the cosmetic.
In one, colour is regarded as alien and therefore dangerous; in the other, it is perceived merely as a secondary quality of experience, and thus unworthy of serious consideration. Colour is dangerous, or it is trivial, or it is both. (It is typical of prejudices to conflate the sinister and the superficial.)
Either way, colour is routinely excluded from the higher concerns of the Mind. It is other to the higher values of Western culture. Or perhaps culture is other to the higher values of colour. Or colour is the corruption of culture. [...]
David Batchelor, excerpt from Chromophobia, London: Reaktion, 2000, p. 22-23.