But why read it in that more convoluted way?

Perhaps just the thing where you are from? I never heard anyone referring to "five minutes before quarter to", it is idiotic. You would say "twenty to four".