Nathan Lambert· @natolambert · X·· 4 小时前AI 评分38
AI 导读
开源模型的“消亡”被大大夸大了,但之前的 AA 指数确实美化了它们。作为行业,我们需要更具体的智能指数,因为 LLM 被用于截然不同的任务。 我关于基准测试行业的元评论。 https://www.interconnects.ai/p/artificial-analysis-v5-and-the-benchmarkers
正文 · 原文
Open models' demise has been greatly exaggerated, but the previous AA index did flatter them. As an industry we need more specific intelligence indices, as LLMs are used in vastly different tasks.
My meta-review on the benchmarking industry.
https://www.interconnects.ai/p/artificial-analysis-v5-and-the-benchmarkers
来源:Nathan Lambert · x.com