Yeah individually religious people can be fairly benign. The fundamental problem is with religion.
Extremists are able to hide behind the guise of religion because non-extremists enable them. Because the only way for “moderate” religious people to oppose religious extremists is to admit that it’s all metaphorical bullshit.