OpenAI· @OpenAI · X·· 3 小时前AI 评分58
AI 导读
OpenAI 推出 LifeVal 基准,用于衡量模型在用户最希望获得帮助的日常事务上的表现,涵盖寻找托育、获取政府服务、管理个人财务等场景。该基准依据数千名 ChatGPT 用户的反馈构建,OpenAI 表示过去一年已用 LifeVal 衡量并改进模型处理这些任务的能力。
正文 · 原文
For AGI to benefit all of humanity, it should help people with the everyday tasks that matter most to them. So we built LifeVal, a new benchmark shaped by feedback from thousands of ChatGPT users on where they most want help from a personal assistant—from finding childcare to accessing government services to managing personal finances.
Over the past year, we’ve used LifeVal to measure and improve how well our models handle these everyday tasks.
来源:OpenAI · x.com