What always feels weird to me, is that we don't need that inflection point of AI turning superintelligent or whatever. Already today, we're producing drones that do autonomous killing, where we just need to scale up production.
I guess, on the plus(?) side, the same is true for bombs and we have not wiped everyone out yet with those either.
That is, I guess, where the inflection point comes in. Killing humans is ultimately quite pointless from a human perspective. But an AI with no understanding of this pointlessness might coordinate the killing with no restraint.
Or well, as the blog post mentions, it might see wiping out humanity as the solution to climate change, or as a way to end violence between humans etc..
Current AI iterations certainly prove to be much better at doing things than deciding whether these things make sense.
all 3 comments