I'm not sure if I understood your deduction. The literal translation of "Zange" would be "tongs", "pliers" or "pincer". Hinges are the things that make doors swing and hold to a wall right?

Multiple source say the origin of the word isn't documented but the best explanation they come up with is that pliers can be used to bend something into a different form.

My guess was it has its origin in the proverb "Das würde ich nicht mal mit der Kneifzange anfassen" which translates to "I wouldn't even touch that with pliers" as in stuff you detest that much that you rather would stay away from it.