跳到正文
Rohan Paul· @rohanpaul_ai · X·· 51 分钟前精选AI 评分78
AI 导读

马里兰大学一篇新论文发现,前沿模型在零样本提示下识别 AI 生成文本的能力已与 Pangram 等训练过的检测器相当,并能用自然语言解释判断依据。作者只给模型一段文本,不给联网、工具或候选名单,测试了判断 AI 还是人类所写、出自哪家实验室的模型、以及具体哪个人所写三项任务。

推荐理由

论文给出前沿模型在零样本下识别 AI 文本并指认作者的具体准确率,可据此重新评估匿名评审的防护假设。

正文 · 原文

New University of Maryland paper finds that frontier models now detect AI-written prose as well as trained detectors like Pangram, while also explaining their reasoning.

Can name a text's author, AI lab or specific person, from that text alone.

Anonymous peer review and pseudonymous accounts assume writing alone doesn't reveal who you are. Spotting AI text was also thought to need trained detectors, not plain prompting.

The authors gave models a single text and a zero-shot prompt, with no web search, tools, or candidate list. They tested AI-or-human detection, which lab's model wrote it, and which person wrote it.

Claude Fable 5.2 named the reviewer of 56% of 398 private peer reviews whose authors were never made public. It named the account behind 69% of comments from Redditors with over 500 posts in a year.

If your product depends on anonymous writing, such as blind review or pseudonymous forums, treat author anonymity as weak and test it against frontier models.

来源:Rohan Paul · x.com