You have to see the sky comet to manipulate the comet, isn't that right? You can't just have wizards willy-nilly affecting matter that they can't perceive!