It grows like a weed so its quite hard to remove

If you're going to plant it, plant it in a pot first, then bury the pot up to the lip. It will stay mostly contained and you won't see the pot unless you're right on top of it. Mint reproduces through runners as well as by seeds and the runners are so much harder to control. If you bury the entire pot, it makes it easier for the runners to escape, which is why you want that little bit of lip above ground.

The secret is to never want to remove it.

It's easy to care for it, you can totally neglect it and it still thrives. When you think it's grown to much, you cut it down, it springs right back. You can rip it out, as long as there's a 5cm piece of root somewhere in the ground, it will be there again next year.

I've ripped out many a bushel and gifted to friends and still have my own mint. I like it.