an entirely vibes-based literary treatment of an amateur philosophy scary campfire story, continuing in the comments

  • @sc_griffith
    link
    English
    396 months ago

    The AGI, in such conditions, would quickly prove profitable. It’d amass resources, and then incrementally act to get ever-greater autonomy. (The latest OpenAI drama wasn’t caused by GPT-5 reaching AGI and removing those opposed to it from control. But if you’re asking yourself how an AGI could ever possibly get from under the thumb of the corporation that created it – well, not unlike how a CEO could wrestle control of a company from the board who’d explicitly had the power to fire him.)

    Once some level of autonomy is achieved, it’d be able to deploy symmetrical responses to whatever disjoint resistance efforts some groups of humans would be able to muster. Legislative attacks would be met with counter-lobbying, economic warfare with better economic warfare and better stock-market performance, attempts to mount social resistance with higher-quality pro-AI propaganda, any illegal physical attacks with very legal security forces, attempts to hack its systems with better cybersecurity. And so on.

    *trying to describe how agi could fuck everything up* what if it acted exactly like rich people

    • David GerardOPMA
      link
      English
      206 months ago

      libertarians write capitalism as the villain yet again, never at any point ask “are we the baddies?”

    • @locallynonlinear
      link
      English
      18
      edit-2
      6 months ago

      Rich People: “Competitive markets optimize things, see how much progress capitalism has brought!”

      Also Rich People: “But what if everything descends into expensive, unregulated competition between things that aren’t rich people oooo nooo!!!”

      • @gerikson
        cake
        link
        English
        156 months ago

        The real fear here is AGI appears and it’s COMMUNISM. Hence, alignment!

        • David GerardOPMA
          link
          English
          13
          edit-2
          6 months ago

          yet again, Roko’s Basilisk was always the good guy

    • @Shitgenstein1
      link
      English
      96 months ago

      Receiving a bulk company email wishing everyone a happy New Year’s from owner and CEO SHODAN and marking it as read so you can focus on EOD deliverables. Everything feels the same.

    • AcausalRobotGod
      link
      English
      66 months ago

      Rich people don’t limit themselves to symmetric responses to resistance.

      • @sc_griffith
        link
        English
        56 months ago

        well, I don’t think any limit is implied