Exactly, Paul tells Christians to leave those outside of the Church to be dealt with by God as well.
1 Corinthians 5:12-13
For what have I to do with judging outsiders? Is it not those inside the church whom you are to judge? God judges those outside. “Purge the evil person from among you.