i think society in general just gets the ick from the idea of people consenting to things being done to their body that they personally dont understand or would never want and tries to stop it to satisfy their own feelings. we see this applied to all kinds of things like abortion, body modification, drug use, suicide, gender transition, sex acts, sexual partners, etc.
These are not all the same thing. Drug use costs society, not just the drug user. Bridge/train jumpers are some of the most selfish people out there; forcing your suicide onto an unrelated driver is the epitome of an asshole move.
Your body your choice is right, but that stops right at the line where it crosses over into other peoples lives.
My point being, duels to the death very easy to argue against simply because of the societal cost of managing them, while completely ignoring any so called 'ick factor' it may or may not have on the majority of people.
Would you be one the people to sign up for body cleaning duty? Would you be happy paying taxes for the dueling arena where it is impossible to prove that there was consent the whole time, every time?