跳到正文
Ethan Mollick· @emollick · X·· 17 小时前AI 评分38
AI 导读

Ethan Mollick指出,仅关注前沿AI研究任务的自主性会严重低估其在经济价值任务中的实际能力。例如Epoch的MirrorCode显示AI可自主重现已需人类2-17周完成的软件,且结合人工指导仍能带来巨大生产力提升。这表明AI驱动的研究进展与经济任务进步并不完全耦合,后者具有更大的方差和不确定性。

正文 · 原文

I think trying to track how much work AI can do autonomously is critical, and this is a useful counter to some of the most audacious claims about the state of autonomous AI research. But I do want to note that the focus on research tasks at the most advanced AI research organizations on the planet also runs the risk of substantially underestimating what AI can already do in terms of economically valuable tasks. Its worth separating the two (and I don't think Ramez is claiming they are not seperated).

Most work is not frontier AI research, and there AI can be tremendously successful. Epoch's MirrorCode results, for example, show AI autonomously reimplementing software that the researchers estimate would take a humans 2-17 weeks. This is well-specified work, so it has very different boundary conditions.

Plus, in the real world, some human intervention is fine (in my mind, vastly preferrable to no human role for a variety of reasons). Occasional guidance can still leave you with enormous productivity gains, even if that doesn’t satisfy the requirements for fully autonomous AI research. And even in the case of AI research, the same OpenAI report includes researchers estimating that a month of their team’s work would have taken three months without coding agents, on average.

In short, RSI/AI-driven research progress may not tightly couple with progress on economically valuable tasks, and the variance and range on those tasks are less well understood.

引用Ramez Naam@ramez
New from me: The most important graphs in AI are wrong. Specifically, measures of the length of task AIs can autonomously accomplish are dramatically different than real-world data from inside OpenAI and Google. 🧵 https://www.rameznaam.com/p/the-most-important-charts-in-ai-are
在 X 查看被引用的帖子

来源:Ethan Mollick · x.com