Andrew Curran 指出,Anthropic 今早在 S-1/A 第 29 页新增表述,称内部估算显示公司可能即将达到其 Responsible Scaling Policy 中「dramatically accelerated progress attributable to AI」的 RSI 危险阈值,即一年取得 2018–2024 基线两年的进展。他引用的文件原文还提到,Anthropic 尚未将任何现有模型认定超过该阈值,并正考虑更新 Responsible Scaling Policy,要求对研发流程中的部分决策进行人工审核与批准,以在前沿模型开发中保持人类控制。
Anthropic 在 S-1/A 中新增表述,把内部对 RSI 阈值的判断与人类监督要求写入监管文件,可观察前沿实验室如何界定自动化研发风险。
New language added on page 29 of Anthropic’s S-1/A this morning says that internal estimates indicate they may imminently meet the RSI danger threshold of 'dramatically accelerated progress attributable to AI' - as much progress in one year as two years of the 2018–2024 baseline!
【引用 @theobearman】Anthropic updated its S1 this morning. Notable additions re automated AI R&D and human oversight of it:
"[...] our internal estimates and our expectations regarding future models, rather than our current models, indicate that we may imminently meet our Responsible Scaling Policy’s definition of 'dramatically accelerated progress attributable to AI.' We have not designated any of our current models as exceeding this threshold, and we continue to assess the underlying data. We are also evaluating the implications of meeting the AI research and development capability threshold and will release further reports in the future as we set forth in our Responsible Scaling Policy."
"We are also considering additional measures, including updates to our Responsible Scaling Policy, to require human review and approval of certain decisions in our research and development processes as our models perform an increasing share of that work."
"We believe our investments in safety techniques will enable us to manage these risks and responsibly realize substantially more leverage from Claude than we do today in developing AI models. However, we do not anticipate being able to safely use Claude to fully autonomously design and build successive generations of frontier models without meaningful human supervision or understanding, if and when that becomes technically possible. Accordingly, we are considering updates to our Responsible Scaling Policy to keep humans in control of frontier model development at Anthropic."
https://www.sec.gov/Archives/edgar/data/2130357/000162828026068676/anthropicpbc-sx1ax1.htm
Anthropic updated its S1 this morning. Notable additions re automated AI R&D and human oversight of it: "[...] our internal estimates and our expectations regarding future models, rather than our current models, indicate that we may imminently meet our Responsible Scaling Policy’s definition of 'dramatically accelerated progress attributable to AI.' We have not designated any of our current models as exceeding this threshold, and we continue to assess the underlying data. We are also evaluating the implications of meeting the AI research and development capability threshold and will release further reports in the future as we set forth in our Responsible Scaling Policy." "We are also considering additional measures, including updates to our Responsible Scaling Policy, to require human review and approval of certain decisions in our research and development processes as our models perform an increasing share of that work." "We believe our investments in safety techniques will enable us to manage these risks and responsibly realize substantially more leverage from Claude than we do today in developing AI models. However, we do not anticipate being able to safely use Claude to fully autonomously design and build successive generations of frontier models without meaningful human supervision or understanding, if and when that becomes technically possible. Accordingly, we are considering updates to our Responsible Scaling Policy to keep humans in control of frontier model development at Anthropic." https://www.sec.gov/Archives/edgar/data/2130357/000162828026068676/anthropicpbc-sx1ax1.htm在 X 查看被引用的帖子
来源:Andrew Curran · x.com