That sounds like something of a thought terminating cliche. I think it's at once simpler and more complicated.
Simpler because most Christians don't think overly much about their beliefs and believe their church's doctrine. More complicated because many do, and those that do think way beyond what's "comfortable". Scholarship going back millennia had dispelled - for scholars - any notion of biblical inerrancy, never mind literalism. For those who don't believe the Bible's plain reading is all true, there is no discomfort here - it would be a supreme arrogance to accuse minds such as Anselm, Augustine and Aquinas of merely believing whatever feels comfortable.
That doesn't mean they're right obviously, but you can do better than such dismissal.