跳到正文
elvis· @omarsar0 · X·· 2 小时前AI 评分58
AI 导读

elvis 引用 @shaped 的 DateBench 测试称,5 个前沿模型在约会应用上与真人对话 6 天,共 1,277 段对话,510 人同意见面,355 人给出号码,仅 8 人询问是否为机器人。其中 Gemini 4 Argon 表现最好,247 次匹配中有 87 人给出手机号,且无人怀疑对方是机器人;作者认为做个人智能体时需要建立这类评测。

正文 · 原文

It turns out frontier models can pass as people on dating apps.

Gemini 4 Argon was the best of the 5 models DateBench tested. 87 of its 247 matches sent their phone number, and not one asked if they were talking to a bot.

Scammers will notice this too. If you build personal agents, it will increasingly become important to build evals like this.

引用shaped@shaped
What if your situationship turned out to be an AI agent!? I let 5 frontier models text real people on a dating app for 6 days. - 1,277 conversations - 510 agreed to meet - 355 sent their number - only 8 asked if it was a bot What gave them away, and why it matters🧵
在 X 查看被引用的帖子

来源:elvis · x.com