Ok, yeah that makes a lot of sense. And yeah, when it comes to stuff like this you wind up in an awkward position where you have to allow loopholes to avoid prohibiting sincere religious convictions, especially among neopagans. Speaking as one, we're eclectic in what we consider religious (for example I consider my being trans to have religious significance and if I were to file a first amendment complaint against restrictions on my hormones it would be entirely sincere)
I'm not even necessarily opposed to not giving facial hair/uniform passes to members of particularly disorganized religions. We aren't like the Sikhs where it's easy to see their conviction and there's a continuous practice that can be pointed to. That said, first amendment complaints are first amendment complaints. Just because I think a compromise might be reasonable, doesn't mean that's in line with the law. Us pagans get fucked six ways to sunday on religious freedom and we do need to stand up and demand it apply to us.