Before starting tasks, developers forecast that allowing AI will reduce completion time by 24%. After completing the study, developers estimate that allowing AI reduced completion time by 20%. Surprisingly, we find that allowing AI actually increases completion time by 19%

N = 16

  • Feyd@programming.dev
    link
    fedilink
    arrow-up
    26
    ·
    5 months ago

    You’re acting like this is a gotcha when it’s actually probably the most rigorous study of AI tool productivity change to date.