跳到正文
Rohan Paul· @rohanpaul_ai · X·· 14 天前AI 评分38
AI 导读

关于禁止RSI(递归自我改进)的讨论越来越响亮了。☹️

正文 · 原文

RSI ban talk is getting louder. ☹️

【引用 @AlexBores】Every AI company is trying to fully automate AI research; to allow the AIs to build the next AI.

This is called Recursive Self Improvement (RSI).

OpenAI says they are on track to do so by March 2028.

Anthropic employees say they are on track to do so by 2027.

The METR report below suggests they are likely right.

This is a bad idea given current technology. Any mistake or misalignment in current AIs could be multiplied in each generation.

We don't get another election before AI companies reach this threshold.

Congress should ban RSI, this year if possible.

This is a remarkably consensus opinion, supported in various versions by:
-Bernie Sanders
-Steve Bannon
-Ralph Nader
-Glenn Beck
-Republican and Democratic attorneys general
-Whistleblower Daniel Kokotajlo
-Turing Award winner Yoshua Bengio
-Humans First
-Open Markets Institute
-Ezra Klein
-Arvind Narayanan (a Princeton computer scientist known for arguing that “AI is a normal technology”)

The exact mechanism can be debated. The ban doesn't have to be permanent either (see below for both). This is not the only thing we have to do in regards to AI, far from it! But it is urgent.

Congress must ban RSI.

引用Alex Bores@AlexBores
Every AI company is trying to fully automate AI research; to allow the AIs to build the next AI. This is called Recursive Self Improvement (RSI). OpenAI says they are on track to do so by March 2028. Anthropic employees say they are on track to do so by 2027. The METR report below suggests they are likely right. This is a bad idea given current technology. Any mistake or misalignment in current AIs could be multiplied in each generation. We don't get another election before AI companies reach this threshold. Congress should ban RSI, this year if possible. This is a remarkably consensus opinion, supported in various versions by: -Bernie Sanders -Steve Bannon -Ralph Nader -Glenn Beck -Republican and Democratic attorneys general -Whistleblower Daniel Kokotajlo -Turing Award winner Yoshua Bengio -Humans First -Open Markets Institute -Ezra Klein -Arvind Narayanan (a Princeton computer scientist known for arguing that “AI is a normal technology”) The exact mechanism can be debated. The ban doesn't have to be permanent either (see below for both). This is not the only thing we have to do in regards to AI, far from it! But it is urgent. Congress must ban RSI.
在 X 查看被引用的帖子

来源:Rohan Paul · x.com