Lisan al Gaib· @scaling01 · X·· 3 小时前AI 评分22
AI 导读
在另一个衍生任务中，移除了知识回忆和图构建组件后，OpenAI 模型同样极其强大。 模型以 100 个词构成图的形式给出，需要从给定起始词出发找到最长简单路径。这最接近于单纯衡量规划能力。
正文 · 原文
On another derived task where the knowledge recall and graph construction components are removed from LisanBench OpenAI models are also extremely strong
Models are given 100 words as a graph and have to find the longest simple path given a starting word. This is closest to measuring just planning
it's good to know that OpenAI models are at least SOTA on a subtask of LisanBench: "When scoring the models without the edit-distance one rule (all the other rules still active) the ranking changes completely: 1. GPT 6 Astra medium: 56,140 (+659%) 2. Gemini 4 Argon high: 51,312 (+579%) 3. GPT 6.1 Sol medium: 49,887 (+731%)" ALL THREE CONFIRMED LOOPERS AT THE TOP 👀在 X 查看被引用的帖子
来源：Lisan al Gaib · x.com