跳到正文
11月3日周二
11月2日周一
10月30日周五
10月29日周四
  1. IT之家72

    Artificial Analysis Intelligence Index v5 基准上线,DeepSeek V4.1 Flash 1017 拿下 FrontierCode 2.0 开源最高分

    Artificial Analysis 发布 Intelligence Index v5,这是自 2026 年 1 月 v4 以来幅度最大的一次基准重构,60% 的评测权重首次建立在私有测试集或隐藏答案之上。

    推荐理由:原文拆解了 v5 把 60% 权重换成私有题后开源与闭源差距从 3 分扩大到 12 分的变化。

10月28日周三
  1. Lisan al Gaib72

    Artificial Analysis 发布 Intelligence Index v5,这是自 v4 以来最大的一次升级,60% 的评测改为基于私有测试集或留出答案。新增 FrontierCode 2.0 和 Terminal-Bench-Science 两项基准,HLE-Diamond、AA-Omniscience v1.1、CritPt v2 完成升级,同时移除 GDPval-AA v2.1、SciCode 和 AA-LCR v1.1。结果显示 Claude Opus 5.5 (max) 以 58 分领先,GPT-6 Astra (max) 57 分、GPT-6.1 Sol (max) 55 分紧随其后,开源权重模型与榜首差距从 3 分扩大到 12 分,Kimi K3.1 Pro 以 46 分居开源首位。作者转发时称这可能是目前最好的一个版本。

    引用Artificial Analysis@ArtificialAnlys

    Announcing Artificial Analysis Intelligence Index v5, featuring 2 new benchmarks and 3 upgrades. For the first time, the majority of the Index is built on private datasets The Artificial Analysis Intelligence Index is our composite measure of model capabilities across tasks reflecting real-world usage today. v5 is our biggest upgrade since v4 launched in January. With v5, 60% of the Index is now based on evaluations with private test sets or held-out answers. Alongside Intelligence Index v5, we’re launching the Artificial Analysis Progress Index v1, which tracks model capability over time on one continuous scale. New to the Intelligence Index: ➤ FrontierCode 2.0: Cognition's newly-launched private benchmark of real-world coding tasks, graded on whether a repository maintainer would merge the agent's change ➤ Terminal-Bench-Science: 70 agentic scientific research tasks, run in a terminal environment Upgraded: ➤ HLE-Diamond (replacing Humanity's Last Exam): a refined 1,000-question version of Humanity's Last Exam, split evenly between reasoning and knowledge questions ➤ AA-Omniscience v1.1: An updated dataset with saturated and public set questions removed, new questions added, and ambiguous or erroneous questions revised ➤ CritPt v2: a private, 40-question hard subset of CritPt v2, revised by the CritPt authors and run with a code-execution tool Staying in the Index: AA-Briefcase, AutomationBench-AA, GDP.pdf and Terminal-Bench 4.0 Removed from the Index: GDPval-AA v2.1, SciCode, and AA-LCR v1.1 Key results: ➤ Claude Opus 5.5 (max) leads at 58, ahead of GPT-6 Astra (max, 57) and GPT-6.1 Sol (max, 55): Anthropic and OpenAI hold the top five models. Gemini 4 Argon (high) is next at 50 ➤ The open weights gap widens from 3 points to 12: Kimi K3.1 Pro (weights not yet released) is the top open weights model at 46. Among released weights, DeepSeek V4.1 Flash 1017 (max) and GLM-5.3 (max) lead at 32 - 26 points behind the leader and below Claude Haiku 5.5 (max, 36) ➤ Cost per task varies by more than 13x among the leading models: of the 10 highest-scoring models shown, GPT-6.1 Terra (max) is the cheapest at $0.96 per Intelligence Index task and Claude Fable 5.1 (max) the most expensive at $13.04

    推荐理由:Artificial Analysis 指数 v5 把 60% 评测换成私有测试集,并给出开源与闭源模型差距扩大的具体分数。

10月24日周六
  1. The Decoder82

    月之暗面发布 Kimi K3.1 Pro,Artificial Analysis 智能指数升至第四

    月之暗面发布 Kimi K3.1 Pro,这是 Kimi K3 的后训练版本,在 Artificial Analysis 智能指数上得分 55,比 K3 提升 11 分,排名第四,仅次于 Claude Opus 5.5(58)、Claude Sonnet 5.5(56)和 Muse Wonder Full(56)。

    同一件事,精选收录的是《月之暗面发布 Kimi K3.1 Pro 模型,编程智能体测评超 GPT-6 Astra》

10月21日周三
10月8日周四
  1. Anthropic70

    Anthropic 发布 Claude Haiku 5.5,称其是迄今最快、最强的小模型。官方称其平均运行成本比 Claude Haiku 4.5 低约 75%。

    引用Claude@claudeai

    Introducing Claude Haiku 5.5: the cheapest, fastest, and most capable small model we’ve ever released. On average, it costs around 75% less to run than Claude Haiku 4.5.

    推荐理由:官方给出 Haiku 5.5 的定位与相对上一代的成本降幅,可据此判断小模型选型。

9月24日周四
9月23日周三
  1. Alex Albert22

    更多内容即将推出。今天只是开始! (引用推文 @mikeyk:我们还将在此后几周内推出 Claude Sonnet 5.5 和 Haiku 5.5。这些模型将在性能、效率和安全性方面带来许多相同的改进。至此,祝大家构建愉快。)

    引用Mike Krieger@mikeyk

    We’re also launching Claude Sonnet 5.5 and Haiku 5.5 in the coming weeks. These models will come with many of the same improvements to performance, efficiency, and safety. With that, happy building everyone.

7月25日周六