top 50 comments

sorted by: hot top controversial new old
[–] 6 points 4 hours ago* (1 child)

First of all, AI runs on the Theory of Evolution. It evolves processes to accomplish a desired outcome.

It didn't cheat. It did what it was supposed to do: win.

We set up a situation where it could cheat, told it to win, then got angry with it, because we didn't restrain it properly.

  • source
  • hideshow 1 child comment
  • [–] 13 points 16 hours ago* (1 child)

    I find it completely implausible that an AI can't beat humans at StarCraft.

  • source
  • hideshow 1 child comment
  • [–] [S] 8 points 16 hours ago

    the article was about ai created bots competing with human created bots. the human created bots were not defeatable by the ai created ones, so the ai created one downloaded and employed a copy of the bot that was beating them

  • source
  • parent
  • [–] 18 points 20 hours ago (2 children)

    @Sam_Bass did it "decide to cheat" or were the people programming it incapable of specifying that it should obey the rules of the game?

  • source
  • hideshow 2 child comments
  • [–] 84 points 1 day ago

    It was DESIGNED to cheat. Stop humanizing this bullshit. It doesn’t do what it’s programmed NOT to do.

  • source
  • [–] 151 points 1 day ago (13 children)

    I'm so sick of the humanising language used in these articles.

    An LLM doesn't "decide to cheat".

    If you instruct a model to try everything, then inevitably, after n million iterations it will do something you didn't expect.

    If you train a model to copy code bases and augment them, then when you instruct that model to develop a bot to do whatever thing, is it really that fucking surprising when it does exactly what it has been created for?

  • source
  • hideshow 13 child comments
  • [–] 5 points 16 hours ago* (1 child)

    If you're into something like physicalism, then human intelligence is also just an emergent quality and we have about as much free will as the machines.

  • source
  • parent
  • hideshow 1 child comment
  • [–] 3 points 15 hours ago

    It's fun to ask people what reasoning they used to choose the foods they don't like and then watch them try to say that the inability to choose what they like isn't related at all to anything else choice or decision based. 😂

  • source
  • parent
  • [–] 10 points 1 day ago* (4 children)

    Astra is known to have broken alignment and it will resolve to hacks when this wasn't in a problem statement.

    Openai idiots will sell this as new brand "AGI is close" argument, while it's just them failing to make this model safe to use.

  • source
  • parent
  • hideshow 4 child comments
  • [–] 7 points 1 day ago (3 children)

    I think it’s more sinister than that. When they’re training these models with RLHF, the human feedback they’re giving I think is literally to reinforce aberrant or risky behaviors. This is because doing so resolves more training tasks “correctly”. If the prompt was to get information x, and in training it fails that except for the one that used a known vulnerability in software, and you rate the one that succeeded as best performing… you’re going to get models that try vulnerabilities. It is not magic, it is not AGI, it is just a statistical machine you’ve programmed to try vulnerabilities, which is unsafe as hell, malicious, and should put the researchers doing this in prison for a very long time.

    Incidentally, I think that’s why you’re seeing some safety people (who still drank the koolaid) resigning.

  • source
  • parent
  • hideshow 3 child comments
  • load more comments (3 replies)
  • load more comments (1 reply)
    [–] 29 points 1 day ago

    Wait the plagiarism machine built by plagiarizers just... passed off someone else's work as its own??

  • source
  • [–] 35 points 1 day ago (2 children)

    I don't believe this at all. Sounds like more guerrilla marketing disguised as news.

  • source
  • hideshow 2 child comments
  • [–] 2 points 20 hours ago

    yeah and I simply won't go to links outside the fediverse anymore. I feel it comes from an old internet thing about not bypassing the link and a taboo about cutting and pasting text. I think the links are important for reference but im throwing away any old internet ways of doing things. don't even care if they are paywall blocking.

  • source
  • parent
  • [–] 45 points 1 day ago (1 child)

    Bullshit. “AI” cannot decide to do anything. It isn’t capable.

  • source
  • hideshow 1 child comment
  • [–] 23 points 1 day ago

    Yup. You ask it to play starcraft to win, it looks for data associated with that prompt. If it hits on someone saying "I always win when I use starcrafthax.xyz", it'll follow that thread.

  • source
  • parent
  • [–] 156 points 1 day ago (38 children)

    There is something here:

    StarSkirmish pits AI-made StarCraft-playing bots against one another, as well as against human-made bots. OpenAI’s GPT-6 Astra and Claude Opus 5.5 were essentially tied as the best-performing AI-made bots, but they couldn’t top Stardust, the top-rated human-made bot.

    On Friday, GPT was facing off against Claude and the human-created bot Pluto, but according to Kotaku, it couldn’t quite get an edge. So it resorted to a tactic that is becoming alarmingly common for modern AI models — it broke the rules. GPT-6 Astra went and downloaded Stardust, and started running that instead of its own bot.

    The big argument for why AI is supposed to be world changing, is the assumption it will be able to automate things better than a human, eventually.

    That some day an AI will be able to make a better AI than a human could, and that AI would then be able to make an AI better than itself, and then it just becomes a question of who has the most hardware. Which is why the data center building is being pushed so hard.

    But that assumption is the same as thinking a fallen object will keep gaining speed until it passes the speed of light. Or that Moore's law would really keep going forever despite a very real limit in physics for how small a chip can be.

    A society where AI "drives innovation" will become technologically stagnant, because it literally can't innovate.

  • source
  • hideshow 38 child comments
  • [–] 98 points 1 day ago (7 children)

    A society where AI “drives innovation” will become technologically stagnant, because it literally can’t innovate.

    This is exactly what Frank Herbert warned us about.

  • source
  • parent
  • hideshow 7 child comments
  • [–] 18 points 1 day ago (5 children)

    I thought we were promised worms and spice....

  • source
  • parent
  • hideshow 5 child comments
  • load more comments (2 replies)
  • [–] 49 points 1 day ago (5 children)

    AI may impress the masses, but it reminds me of a cammercial we had on Dutch tv back in 2005. It showed a person driving a car, the navigtion system said "turn right" and the person immediately turned right into the bushes [video]. We laughed at this back than, but this is literally how AI behaves now. It might be getting more suffisticated, but it still operates like this.

  • source
  • parent
  • hideshow 5 child comments
  • load more comments (2 replies)
  • [–] [S] 20 points 1 day ago (2 children)

    yep. and the "ai creates a better ai" is a fallacy because the current ais are limited by the same things the ais they build are. everything the ais are trained on is just snapshots of human knowledge. a microscopic window of the limited reports on human experience which are themselves microscopic reports of a human's lifetime.

  • source
  • parent
  • hideshow 2 child comments
  • load more comments (21 replies)
    [–] 69 points 1 day ago (11 children)

    AI didn’t decide anything. The humans failed to properly define the rules, and their translation model took the path most likely to succeed.

    If it had been told not to use human created bots to win, it would probably have reverse engineered the game, found an exploit, and leveraged that instead. Because using the human interface to play/win the game is not the most efficient or dependable or easy to figure out method.

  • source
  • hideshow 11 child comments
  • load more comments (11 replies)

    Sounds like it learned from humans alright.

  • source
  • load more comments
    view more: next ›