To begin with they have to make sure that those ex-players never ref any of their ex-clubs or ex-clubs rivals because everyone with just question their motives.
Secondly I have no idea why people believe ex-players would make good refs..
Seriously you just have to listen to many off them on Skysports, Talksport, BBC, various podcasts that the vast majority of them are morons