They're right. I get the point, you should pay attention and not be disruptive, but there are definitely ways to fidget that aren't distracting to others.