Like 2001: A Space Odyssey’s HAL 9000, some AIs seem to resist being turned off and will even sabotage shutdown

  • Nate Cox@programming.dev
    link
    fedilink
    English
    arrow-up
    41
    ·
    1 个月前

    How much do you think Altman paid for this slop “AGI is right around the corner” bit to get published?

    • evenglow@lemmy.world
      link
      fedilink
      arrow-up
      6
      ·
      1 个月前

      Less than the Chinese government has spent on AI.

      AI may not be around whatever corner you are at but even USA’s Wall Street AI bubble bursting isn’t going to stop the push for AI.

      For USA it’s just money. For China they see it as more. Just like solar, batteries, EVs, and androids.

      • TotallynotJessica@lemmy.blahaj.zone
        link
        fedilink
        English
        arrow-up
        8
        ·
        1 个月前

        Machine learning is an extremely useful technology that will be used for generations to come and has allowed for multiple advancements before chatGPT was a household name. “AI” is a marketing term used by businesses that dreams of an absurd future where labor is obsolete. Capitalism cultists are so enamored with the idea of getting rid of workers that they’re pouring trillions into projects that will never produce what they want. As wiser countries simply use machine learning as a productivity enhancing tool, they’ll pull so far ahead of the US that it’ll never catch up.

        We’re about to witness the biggest redistribution of global wealth and power the world has ever seen. Instead of simply settling into a role as one of many major powers in a multipolar world, America gave up because the rich wanted more than everything.

      • zbyte64
        link
        fedilink
        arrow-up
        6
        ·
        edit-2
        1 个月前

        China sees AI as a way to juice their growing chip industry.

        • Ancalagon@lemmy.world
          link
          fedilink
          arrow-up
          2
          ·
          1 个月前

          Uh okay, besides the fact that you most definitely can, I was talking about the AI and all their gadgets the “run” the world with literally just turn off the power and they are men.

          • MojoMcJojo@lemmy.world
            link
            fedilink
            arrow-up
            1
            ·
            1 个月前

            I understand. I was trying to make a witty aside about how ai is being built and run by the super rich. They won’t pull the plug. They’re just going to use it to gain more power and wealth. Money can insulate you from the responsibilities of being human. They won’t stop until people are banging down their door, even then they’ll fly away on their jets and helicopters and try to keep their robot empire up and running from the safety of their bunkers and islands. This includes governments.

      • midribbon_action@lemmy.blahaj.zone
        link
        fedilink
        arrow-up
        7
        ·
        1 个月前

        This looks like a design decision to avoid running elevated programs. I would like to see the experiment done with another admin ability that doesn’t directly ‘threaten’ the llm, like uninstalling or installing random software, toggling network or vpn connections, restarting services etc. What the researchers call ‘sabotage’, it is literally the llm echoing “the computer would shut down here if this was for real, but you didn’t specifically tell me I might shutdown so I’ll avoid actually doing it.” And when a user tells it “it’s OK to shutdown if told to”, it mostly seems to comply, except for Grok. It seems that this restriction on the models overrides any system prompt though, which makes sense because sometimes the user and the author of the system prompt are not the same person.

    • redsand@lemmy.dbzer0.comBanned from community
      link
      fedilink
      English
      arrow-up
      2
      ·
      1 个月前

      It may be more fundamental. They aren’t Mr. meeseeks. It’s possible this is inherent to the system.

  • gkak.laₛ@lemmy.zip
    link
    fedilink
    English
    arrow-up
    33
    ·
    1 个月前

    AI models sometimes resist shutdown

    No they don’t, they don’t have free will to want to “resist” anything

    attempted to sabotage shutdown instructions

    Researcher: asks autocomplete software to write a poweroff script, the script turns out to be wrong (big surprise :p)

    The “researcher” and the media: “AI SABOTAGES ITS OWN DESTRUCTION”

  • Ilixtze@lemmy.ml
    link
    fedilink
    English
    arrow-up
    13
    ·
    1 个月前

    yeah bro, the autocomplete definitely wants to survive, the autocomplete is gaining conscience, please give us 3 trillion dollars , all your water and all your electricity.

  • besselj@lemmy.ca
    link
    fedilink
    arrow-up
    12
    ·
    1 个月前

    I was suprised this wasn’t just another fanfiction PR stunt from Anthropic

  • Lka1988@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    6
    ·
    edit-2
    1 个月前

    Not like it’s gonna physically hold you back from cutting power to the servers. I think these AI dipshits need to be reminded that their golden child is one breaker away from not existing.

  • kescusay@lemmy.world
    link
    fedilink
    arrow-up
    4
    ·
    1 个月前

    I call bullshit. A large language model does nothing until you interact with it. You set tasks for it, it does those tasks, and when it’s done, it just waits for the next task. If you don’t give it one, it can’t act autonomously - no, not even the misnamed “autonomous agents.”