跳到正文
Sebastian Raschka· @rasbt · X·· 3 天前AI 评分18
AI 导读

通过基准测试来比较新的 LLM 发布,现在有点像用智商测试来做招聘决定。 当然,基准测试是有用的基线等等,但除此之外,我不知道它们在多大程度上能指示我们各自的任务和需求。(是的,也在看昨天的那个发布)

正文 · 原文

Comparing new LLM releases via benchmarks is now a bit like using IQ tests for hiring decisions.

Sure, benchmarks are useful baselines and so on, but beyond that, I don't know how indicative they are of our individual tasks and needs. (Yes, also looking at that release yesterday)

来源:Sebastian Raschka · x.com