https://www.reuters.com/technology/artificial-intelligence/openai-co-founder-sutskevers-new-safety-focused-ai-startup-ssi-raises-1-billion-2024-09-04/

http://web.archive.org/web/20240904174555/https://ssi.inc/

I have nothing witty or insightful to say, but figured this probably deserved a post. I flipped a coin between sneerclub and techtakes.

They aren’t interested in anything besides “superintelligence” which strikes me as an optimistic business strategy. If you are “cracked” you can join them:

We are assembling a lean, cracked team of the world’s best engineers and researchers dedicated to focusing on SSI and nothing else.

  • @selfA
    link
    English
    293 months ago

    ah yeah, 10 employees and “worth” $5 billion, utterly normal bubble shit

    Sutskever was an early advocate of scaling, a hypothesis that AI models would improve in performance given vast amounts of computing power. The idea and its execution kicked off a wave of AI investment in chips, data centers and energy, laying the groundwork for generative AI advances like ChatGPT.

    but don’t sweat it, the $1 billion they raised is going straight to doing shit that doesn’t fucking work but does fuck up the environment, trying to squeeze more marginal performance gains out of systems that plateaued when they sucked up all the data on the internet (and throwing money at these things not working isn’t even surprising, given a tiny amount of CS knowledge)

    • @imadabouzu
      link
      English
      163 months ago

      I don’t get it. If scaling is all you need, what does a “cracked team” of 5 mean in the end? Nothing?

      What’s, the different between super intelligence being scaling, and super intelligence, being whatever happens? Can someone explain to me the difference between what is and what SUPER is? When someone gives me the definition of super intelligence as “the power to make anything happen,” I always beg, again, “and how is that different precisely from not, that?”

      The whole project is tautological.

      • @Soyweiser
        link
        English
        83 months ago

        I’m just amused that their scaling program doesn’t scale properly. Due to the hungry hungry AI needing more and more data.

      • @conciselyverbose@sh.itjust.works
        link
        fedilink
        English
        43 months ago

        Superintelligence is an AI meaningfully beyond human capability.

        It pretty obviously can’t be achieved by brute forcing something already way past diminishing returns, though.

        • David GerardMA
          link
          English
          63 months ago

          just a few billion more bro

        • @imadabouzu
          link
          English
          33 months ago

          I’m actually, not convinced that AI meaningfully beyond human capability actually makes any sense, either. The most likely thing is that after stopping the imitation game, an AI developed further would just… have different goals than us. Heck, it might not even look intelligent at all to half of human observers.

          For instance, does the Sun count as a super intelligence? It has far more capability than any human, or humanity as a whole, on the current time scale.

          • @aio
            link
            English
            63 months ago

            No, but the moon does.

          • @YourNetworkIsHaunted
            link
            English
            53 months ago

            Capability is such a vague word, and intelligence isn’t all that much better defined.

  • Sailor Sega SaturnOP
    link
    English
    173 months ago

    Eliezer is skeptical, can find flaw in any alignment strategy in 2 minutes: https://x.com/ESYudkowsky/status/1803676608320192617

    If you have an alignment plan I can’t shoot down in 120 seconds, let’s hear it. So far you have not said anything different from the previous packs of disaster monkeys who all said exactly this almost verbatim, but I’m open to hearing better.

    • @selfA
      link
      English
      233 months ago

      is… is yud one of the disaster monkeys? or are we supposed to forget he spent a bunch of years running and renaming an institute that tried and failed to do this exact same alignment grift?

      • @sc_griffith
        link
        English
        53 months ago

        yud is the uniquely capable person in this area. anyone who even sets foot in it should make groveling to him a high priority. these people are disaster monkeys because they aren’t doing that

  • @sc_griffith
    link
    English
    123 months ago

    you know a company is very serious when it uses game balance terminology to describe its HR practices. “I’m sorry, we’re going to have to nerf your salary”

    • @swlabr
      link
      English
      113 months ago

      “Your wages feel overtuned.”

      “We’re thinking of reworking your position.”

      “This company is in beta. Your position is not fixed and might not be in the final product.”

      Tangent: As a first time participant in an early access game, I came across the term “overtuned” which made me irrationally angry. My understanding is that it is supposed to mean “you buffed this because of feedback but maybe a little too much” but I have rarely seen it used to mean other than “this needs a nerf, and I won’t justify my position, but I want to sound like I’m reasonable”

      • @selfA
        link
        English
        133 months ago

        “you buffed this because of feedback but maybe a little too much” but I have rarely seen it used to mean other than “this needs a nerf, and I won’t justify my position, but I want to sound like I’m reasonable”

        please never let me make the mistake of becoming a game developer; I absolutely would be the guy who closes this ticket with “fuck off gamer” and gets us review bombed by the worst parts of our playerbase

      • @froztbyte
        link
        English
        83 months ago

        Tangent: As a first time participant in an early access game, I came across the term “overtuned” which made me irrationally angry. My understanding is that it is supposed to mean “you buffed this because of feedback but maybe a little too much” but I have rarely seen it used to mean other than “this needs a nerf, and I won’t justify my position, but I want to sound like I’m reasonable”

        never, ever, ever play EVE. you might pop a vein in apoplexy

        (CCP demonstrates some of the most stunning lack of systemic thinking and basic hypothesis testing on the very damn thing they control, and it frequently does my head in)

        • @swlabr
          link
          English
          53 months ago

          I think I’ve seen a bit of it and thought that it was a game that could kill me in that manner!!!

  • @antifuchs
    link
    English
    113 months ago

    It’s called “safe superintelligence” because they want investors to sign SAFE agreements and feel very smart about it.

  • @swlabr
    link
    English
    53 months ago

    I’m thinking this is a POSIWID kind of deal. The mission statement of this company should just be: “A. I. Money please!”

    • @froztbyte
      link
      English
      53 months ago

      or “AI! Money, please?”, in the most extreme conductor voice possible