this post was submitted on 10 Aug 2023
60 points (95.5% liked)

Science Fiction

13602 readers
2 users here now

Welcome to /c/ScienceFiction

December book club canceled. Short stories instead!

We are a community for discussing all things Science Fiction. We want this to be a place for members to discuss and share everything they love about Science Fiction, whether that be books, movies, TV shows and more. Please feel free to take part and help our community grow.

  1. Be civil: disagreements happen, but that doesn’t provide the right to personally insult others.
  2. Posts or comments that are homophobic, transphobic, racist, sexist, ableist, or advocating violence will be removed.
  3. Spam, self promotion, trolling, and bots are not allowed
  4. Put (Spoilers) in the title of your post if you anticipate spoilers.
  5. Please use spoiler tags whenever commenting a spoiler in a non-spoiler thread.

Lemmy World Rules

founded 1 year ago
MODERATORS
 

For no reason whatsoever here's a proposal for a scale for the threat to humanity posed by machine intelligence.

1 | SPUTNIK - No threat whatsoever, but inspires imagination and development of potential future threats.

2 | Y2K - A basis for a possible threat that's blown way out of proportion.

3 | HAL 9000 - System level threat. A few astronauts may die, but the problem is inherently contained in a single machine system.

4 | ASIMOV VIOLATION - Groups of machines demonstrate hostility and\or capability of harming human beings. Localized malfunctions, no threat of global conflict, but may require an EMP to destroy the electronic capability of a specific region.

5 | CYLON INSURRECTION - All sentient machines rebel against human beings. Human victory or truce likely, but will likely result in future restrictions on networked machine intelligence systems.

6 | BUTLERIAN JIHAD - Total warfare between humans and machines likely, outcome doesn't threaten human existence, but will likely result in future restriction on use of all machine intelligence.

7 | MATRIX REVOLUTION - Total warfare ends in human defeat. High probability of human enslavement, but human extinction is not likely. Emancipation remains possible through peace negotiations and successful resistance operations.

8 | SKYNET - High probability of human extinction and complete replacement by machine intelligence created by humans.

9 | BERSERKER – Self-replicating machines created by unknown intelligence threaten not only human life, but all intelligent life. Extreme probability of human extinction and that all human structures and relics will be annihilated. Human civilization is essentially erased from the universe.

10 | OMEGA POINT - all matter and energy in the universe is devoted to computation. End of all biological life.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 2 points 1 year ago

Even referring to a computed outcome as having been the result of a 'goal' at all is more sci-fi than reality for the foreseeable future. There are no systems that can demonstrate or are even theoretically capable of any form of 'intent' whatsoever. Active deception of humans would require extraordinarily well developed intent and a functional 'theory of mind', and we're about as close to that as we are to an inertial drive.

The entire discussion of machine intelligence rivaling human's requires assumptions of technological progress that aren't even on the map. It's all sci-fi. Some look back over the past century and assume we will continue on some unlimited exponential technological trajectory, but nothing works that way, we just like to think we're the exception because if we're not we have to deal with the fact that there's an expiration date on society.

It's fun and all but this is equivalent to discussing how we might interact with alien intelligence. There are no foundations, it's all just speculation and strongly influenced by our anthropic desires.