Apple 新论文提出 AMP1 框架,让 Claude Opus 5.5、Gemini 4 Argon 等通用模型通过相机画面、代码执行和直接运动指令循环控制机械臂,无需演示数据或任务训练。
论文给出通用模型直接控制机械臂的零样本成功率与真实机械臂试验数据,可与专用 VLA 策略对照。
New Apple paper shows that a general-purpose AI model like Claude Opus 5.5, given camera views and direct control of a robot arm, handled objects more reliably than robot models trained on recorded demonstrations.
New Apple paper shows that a frontier AI model directly controlling a robot arm beats specialist robot policies, with no demonstrations or task training.
Most robot manipulation work trains specialist policies, like vision-language-action models, on demonstrations, and they break easily when instructions change.
Their harness, AMP1, gives a model like Claude Opus 5.5 or Gemini 4 Argon camera views, code execution, and direct motion commands in a loop. It has no built-in grasping or placing skills, so the model invents its own strategies.
On RoboLab-120, AMP1 succeeded in 85.6% of episodes zero-shot, against 49.2% for the best VLA and 42.9% for the best world-action model. On a real Franka arm it succeeded in 104 of 108 trials, though the robot waits much of each episode for the model.
来源:Rohan Paul · x.com