• blakestaceyA
    link
    fedilink
    English
    arrow-up
    22
    ·
    10 个月前

    Paragraph 2:

    METR funded 16 experienced open-source developers with “moderate AI experience” to do what they do.

    • HedyL
      link
      fedilink
      English
      arrow-up
      29
      ·
      10 个月前

      … and just a few paragraphs further down:

      The number of people tested in the study was n=16. That’s a small number. But it’s a lot better than the usual AI coding promotion, where n=1 ’cos it’s just one guy saying “I’m so much faster now, trust me bro. No, I didn’t measure it.”

      I wouldn’t call that “burying information”.

    • swlabr
      link
      fedilink
      English
      arrow-up
      15
      ·
      10 个月前

      <vapid statement>. Debate me bro? (jk)