AI research lab that published findings showing AI tools slowed open-source developers despite their perception of increased productivity.
“Across all 25 target programs, 17/25 had at least one perfect-scoring run.”
Source→“MirrorCode is a tractable but hard benchmark, though perhaps a little too easy.”
Source→“Researchers measured how much time open source developers took to do tasks by hand versus with AI. While developers in that study reported that AI was making them more productive, they were shocked to learn it actually slowed them down.”
AI-extracted from podcast / newsletter / paper summaries. May contain errors.