跳到正文
Andrew Curran· @AndrewCurran_ · X·· 5 小时前AI 评分58
AI 导读

Andrew Curran 引述 OpenAI 首席科学家 Jakub Pachocki 对 2027 年前后能力加速的判断:OpenAI 一年多来用数学开放问题评测模型,升级到 log-perplexity 约 0.76 的模型后,模型开始接连给出长期悬而未决问题的解答。

正文 · 原文

Jakub Pachocki, Chief Scientist at OpenAI, on the impending capabilities acceleration in 2027:

'We have recently witnessed unprecedented acceleration in another domain. For more than a year, we have been posing open problems in mathematics to our models as one of the ways of evaluating them. Once we upgraded to a model of log-perplexity ~0.76, it started producing groundbreaking results. For many of us that have previously worked in mathematics and adjacent fields, seeing the resolutions to questions we've long thought about coming out of the model one after another in a single Slack thread felt deeply surreal. Having experienced that allows us to extrapolate - such a sudden transformation is plausible in deep learning research too. While this field relies more on experimentation, there is a long history of simple insights being missed for years; and so as soon as 2027 we could conceivably see a similar avalanche of fundamental pretraining advancements.'

引用Jakub Pachocki@merettm
We decided to provide more transparency into pretraining progress at OpenAI for the sake of moving toward shared safety bars. In “Perplexity and Intelligence” I argue for common limits based on perplexity and other measurements, with progress beyond them gated on our ability to understand AI behavior. https://openai.com/index/perplexity-and-intelligence
在 X 查看被引用的帖子

来源:Andrew Curran · x.com