Getting a mail server configured correctly, in a way that prevents you from becoming a paradise for spammers, is NOT easy. This is probably one of the more difficult self hosting projects there is. Getting it wrong can have consequences for others, not just yourself.

I'm not saying don't do it. Just do your research, be aware of what you're getting in to, and maybe have some other people check your work.