You're not supposed to. You need enemies around to be able to farm them for materials.

You can't. Apparently when you kill a ton of enemies really fast the blood moon happens quicker. At least according to some other person on this thread

Enemies you defeat will stay gone until the next Blood Moon, which triggers after you defeat a certain percentage of enemies in the world. It's designed to keep the game exciting and fresh so there are always enemies around.