跳到正文
Rohan Paul· @rohanpaul_ai · X·· 23 小时前AI 评分58
AI 导读

OpenAI 发布了药物化学基准 MedChemBench,题目来自 117 篇论文和专利,覆盖 761 个带评分的分子结构,并隐藏了研究者后来报告的结果。每个提示词停在真实决策点,给出生物靶点、已合成化合物和部分测定结果。表现最好的模型 GPT-6.2 Astra 总体约 84%,在化学结构解读上接近满分,但在真正关键的决策上只有约一半正确。

正文 · 原文

OpenAI has now published MedChemBench, its medicinal chemistry benchmark.

Its problems come from 117 papers and patents, span 761 graded molecular structures, and withhold the results researchers reported later.

Each prompt stops at a real decision point, supplying the biological target, the compounds made so far and selected assay results.

the best model GPT-6.2 Astra gets about 84% overall, is near perfect at reading the chemistry, and is right about half the time on the decision that actually matters.

来源:Rohan Paul · x.com