https://www.reuters.com/technology/artificial-intelligence/openai-co-founder-sutskevers-new-safety-focused-ai-startup-ssi-raises-1-billion-2024-09-04/

http://web.archive.org/web/20240904174555/https://ssi.inc/

I have nothing witty or insightful to say, but figured this probably deserved a post. I flipped a coin between sneerclub and techtakes.

They aren’t interested in anything besides “superintelligence” which strikes me as an optimistic business strategy. If you are “cracked” you can join them:

We are assembling a lean, cracked team of the world’s best engineers and researchers dedicated to focusing on SSI and nothing else.

  • self@awful.systems
    link
    fedilink
    English
    arrow-up
    29
    ·
    4 months ago

    ah yeah, 10 employees and “worth” $5 billion, utterly normal bubble shit

    Sutskever was an early advocate of scaling, a hypothesis that AI models would improve in performance given vast amounts of computing power. The idea and its execution kicked off a wave of AI investment in chips, data centers and energy, laying the groundwork for generative AI advances like ChatGPT.

    but don’t sweat it, the $1 billion they raised is going straight to doing shit that doesn’t fucking work but does fuck up the environment, trying to squeeze more marginal performance gains out of systems that plateaued when they sucked up all the data on the internet (and throwing money at these things not working isn’t even surprising, given a tiny amount of CS knowledge)

    • imadabouzu@awful.systems
      link
      fedilink
      English
      arrow-up
      16
      ·
      4 months ago

      I don’t get it. If scaling is all you need, what does a “cracked team” of 5 mean in the end? Nothing?

      What’s, the different between super intelligence being scaling, and super intelligence, being whatever happens? Can someone explain to me the difference between what is and what SUPER is? When someone gives me the definition of super intelligence as “the power to make anything happen,” I always beg, again, “and how is that different precisely from not, that?”

      The whole project is tautological.

      • Soyweiser@awful.systems
        link
        fedilink
        English
        arrow-up
        8
        ·
        4 months ago

        I’m just amused that their scaling program doesn’t scale properly. Due to the hungry hungry AI needing more and more data.

      • conciselyverbose@sh.itjust.works
        link
        fedilink
        English
        arrow-up
        4
        ·
        4 months ago

        Superintelligence is an AI meaningfully beyond human capability.

        It pretty obviously can’t be achieved by brute forcing something already way past diminishing returns, though.

        • imadabouzu@awful.systems
          link
          fedilink
          English
          arrow-up
          4
          ·
          4 months ago

          I’m actually, not convinced that AI meaningfully beyond human capability actually makes any sense, either. The most likely thing is that after stopping the imitation game, an AI developed further would just… have different goals than us. Heck, it might not even look intelligent at all to half of human observers.

          For instance, does the Sun count as a super intelligence? It has far more capability than any human, or humanity as a whole, on the current time scale.

    • self@awful.systems
      link
      fedilink
      English
      arrow-up
      23
      ·
      4 months ago

      is… is yud one of the disaster monkeys? or are we supposed to forget he spent a bunch of years running and renaming an institute that tried and failed to do this exact same alignment grift?

  • sc_griffith@awful.systems
    link
    fedilink
    English
    arrow-up
    12
    ·
    4 months ago

    you know a company is very serious when it uses game balance terminology to describe its HR practices. “I’m sorry, we’re going to have to nerf your salary”

    • swlabr@awful.systems
      link
      fedilink
      English
      arrow-up
      11
      ·
      4 months ago

      “Your wages feel overtuned.”

      “We’re thinking of reworking your position.”

      “This company is in beta. Your position is not fixed and might not be in the final product.”

      Tangent: As a first time participant in an early access game, I came across the term “overtuned” which made me irrationally angry. My understanding is that it is supposed to mean “you buffed this because of feedback but maybe a little too much” but I have rarely seen it used to mean other than “this needs a nerf, and I won’t justify my position, but I want to sound like I’m reasonable”

      • self@awful.systems
        link
        fedilink
        English
        arrow-up
        13
        ·
        4 months ago

        “you buffed this because of feedback but maybe a little too much” but I have rarely seen it used to mean other than “this needs a nerf, and I won’t justify my position, but I want to sound like I’m reasonable”

        please never let me make the mistake of becoming a game developer; I absolutely would be the guy who closes this ticket with “fuck off gamer” and gets us review bombed by the worst parts of our playerbase

      • froztbyte@awful.systems
        link
        fedilink
        English
        arrow-up
        8
        ·
        4 months ago

        Tangent: As a first time participant in an early access game, I came across the term “overtuned” which made me irrationally angry. My understanding is that it is supposed to mean “you buffed this because of feedback but maybe a little too much” but I have rarely seen it used to mean other than “this needs a nerf, and I won’t justify my position, but I want to sound like I’m reasonable”

        never, ever, ever play EVE. you might pop a vein in apoplexy

        (CCP demonstrates some of the most stunning lack of systemic thinking and basic hypothesis testing on the very damn thing they control, and it frequently does my head in)

        • swlabr@awful.systems
          link
          fedilink
          English
          arrow-up
          5
          ·
          4 months ago

          I think I’ve seen a bit of it and thought that it was a game that could kill me in that manner!!!

  • antifuchs@awful.systems
    link
    fedilink
    English
    arrow-up
    11
    ·
    4 months ago

    It’s called “safe superintelligence” because they want investors to sign SAFE agreements and feel very smart about it.

  • swlabr@awful.systems
    link
    fedilink
    English
    arrow-up
    5
    ·
    4 months ago

    I’m thinking this is a POSIWID kind of deal. The mission statement of this company should just be: “A. I. Money please!”