跳到正文
The Decoder· Jonathan Kemper·· 5 小时前AI 评分63

新实验:AI 编码智能体在模拟职场中完整完成不足一成任务

AI coding agents ace isolated tests but complete fewer than one in ten tasks in a simulated workplace

AI 导读

一项新实验首次让 AI 编码智能体以数字员工身份进入带同事、项目看板和聊天记录的模拟软件公司,即使 Claude Opus 5.5 和 GPT-6 Astra 也完整完成不足十分之一的任务。文章指出,AI 编码智能体在 SWE-bench 等标准基准上接近饱和,Anthropic 称 Claude 编写了公司超过 80% 的生产代码。

正文 · 原文

Image description

ChatGPT-5.6 prompted by THE DECODER

AI coding agents are nearing top scores on standard benchmarks. A new experiment puts them to work for the first time as digital employees inside a simulated software company with colleagues, project boards, and chat histories. Even Claude Opus 5.5 and GPT-6 Astra fully complete fewer than one in ten tasks.

Success stories about AI coding agents keep piling up. Anthropic says Claude writes more than 80 percent of the company's production code, and standard benchmarks like SWE-bench are nearly saturated.

来源:The Decoder · the-decoder.com