跳到正文
The Decoder· Matthias Bastian·· 1 小时前同事件AI 评分88

Google 发布 Gemini 4 Hydrogen,发布四周后在 AA 智能指数上超过更大的 Argon

Google's Gemini 4 Hydrogen outscores the bigger Argon just four weeks after its launch

AI 导读

Google 发布面向开发者和日常用户的快速通用模型 Gemini 4 Hydrogen,在默认 high 思考级别下以 51 分超过 Gemini 4 Argon 的 50 分,xhigh 级别可达 54 分。

同一件事,精选收录的是《Google DeepMind 发布 Gemini 4 Hydrogen 模型》

正文 · 原文

Google has released Gemini 4 Hydrogen, a fast general-purpose AI model meant for developers and everyday users.

Unlike the frontier models Gemini 4 Carbon and Gemini 4 Argon, which Google designed for deep, long-horizon reasoning on hard problems, Hydrogen is meant to handle everyday tasks quickly and cheaply. It appears to be the counterpart to the earlier Flash series.

That comparison may sell it short, though. According to Google, Hydrogen beats the larger Argon on the Artificial Analysis Intelligence Index at the default "high" thinking level (51 vs. 50) and reaches up to 54 at the highest level, "xhigh."

Hydrogen offers four thinking levels: low, medium, high (the default), and a new xhigh tier, while Argon offers only medium and high. The model has a one-million-token context window for input and can output one million tokens. It costs $1.50 per million input tokens and $7.50 per million output tokens. Cache hits cost $0.075.

At "xhigh," Gemini 4 Hydrogen scores 54 on the Artificial Analysis Intelligence Index, just behind Claude Sonnet 5.5 and GPT-6.1 Sol, which each score 55 at their maximum thinking level. Gemini 4 Argon trails at 50. | Source: Artificial Analysis

Hydrogen apparently ends up both more capable and cheaper than Argon. Adding to the confusion, when Google announced its new frontier model Carbon just two days ago, the company recommended sticking with Argon for daily coding work. Hydrogen should make that advice moot, leaving Argon obsolete less than four weeks after its release.

Hydrogen delivers a major jump over the previous Flash generation

Google pitches Hydrogen as a standalone model and a big upgrade over Gemini 3.8 Flash. At the default thinking level, Google says it finishes tasks 2.5 times faster. On Terminal-Bench 4.1, the score jumps from 18.2 percent (Flash) to 57 percent (Hydrogen). Hallucinations dropped by a factor of five, and the model recovers better when a tool call fails or a search comes up empty, Google says.

On open-ended agent tasks like research, data analysis, and code navigation, Hydrogen ranks fifth on the Agent Arena leaderboard. Google says it takes first place on the Vals Tax Agent Bench with 52.3 percent and ties for first on the Vals Legal Research Bench with 55.8 percent.

Category Benchmark Gemini 4 Hydrogen Gemini 4 Carbon Gemini 4 Argon
General Abilities AA Index v5.0 54 (xhigh, 5.1) 59 50
Vals Index v2.2 — 70.4% 69.2%
Agentic coding SWE-sweep 13.5% 9.6% 4.3%
FrontierSWE 2 — 61.2% 55.0%
Terminal-Bench 4.1 (cheating-adjusted) 57.0% — —
Terminal Bench 4.0 (AA) — 65.2% 57.1%
Knowledge Work Agents’ Last Exam v1.1 71.6% 77.4% 69.0%
AutomationBench 76.1% — —
AutomationBench (Zapier) — 53.9% 51.3%
Vending-Bench 2 (Account Balance, U.S. Dollars) $14,549 $16,484 $13,718
Computer Use OSWorld-2.1 (offline subset) 77.6% 81.5% 74.7%
Multimodal Understanding MKA (Climb WSR accuracy) 53.4% — —
Chartography 66.6% 72.5% 71.6%
Blueprint Bench 2 (Similarity Score) — 58.6% 54.4%
Long Context GraphWalks (256k to 1M, BFS) — 96.2% 84.2%
Science and Mathematics Terminal-Bench-Science 0.1 51.4% — —
RiemannBench — 80.0% 76.0%
Terminal-Bench-Science 0.1 (AA) — 64.8% 52.9%
Reasoning HLE-Diamond 58.8% — —
Cybersecurity CWE-bench — 71.0% 68.0%
ExploitGym — 54.8% 42.0%
SEC-bench Pro — 88.2% 83.4%

For multimodal knowledge work like summarizing large PDFs, spreadsheets, or videos, Hydrogen supports up to one million output tokens on top of its one-million-token input window. It scores 53.4 percent on Google's new Multimodal Knowledge Agent Benchmark and 71.6 percent on Agents' Last Exam v1.1.

Hydrogen is available now

Google is rolling Hydrogen out globally across all platforms. Developers get access through the Gemini API in AI Studio and Android Studio, while paying Pro and Ultra subscribers can use it through Google Antigravity. Business customers get it through Gemini for Business, and it's available to everyone in the Gemini app and Google Search.

In the Gemini app, Google says the model sticks more closely to tone, format, and instructions over longer conversations, so drafts, summaries, and documents are more often usable on the first try. Hydrogen can also pull in context from Google apps like Gmail and Drive, as well as third-party apps like Airtable and Dropbox.

Google claims Hydrogen is a "significant upgrade" for Search, too. The model handles search queries better, even when they contain typos, multi-part questions, or very specific requests, Google says. Results are more visual and easier to scan, and an improved query fan-out technique pulls in a wider range of relevant links.

In Google's benchmark comparison, Gemini 4 Hydrogen beats Claude Sonnet 5.5 and GPT-6.1 Terra on the knowledge work and multimodal understanding tests shown. Sonnet, however, scores highest on terminal tasks and computer use. | Source: Googl

In Antigravity, Google's coding tool, a new orchestrator switches dynamically between Carbon and Hydrogen within a session instead of sticking with one model. On the external benchmark Terminal-Bench 4.0, Google says the orchestrator nearly matches Carbon's success rates while using 24 percent fewer resources and cutting processing time by 19 percent.

Independent test finds Hydrogen rarely hallucinates but lags on terminal work

An independent evaluation by Artificial Analysis puts Hydrogen roughly on par with Claude Sonnet 5.5 at its highest thinking level. At the default "high" level, the score drops to 51, slightly behind GPT-6.1 Sol (xhigh, 52) and Claude Opus 5.5 (high, 52).

On the AA-Omniscience benchmark, Hydrogen makes things up only 8 percent of the time, according to Artificial Analysis. It also beats other Gemini models, including Carbon, on presentation quality in AA-Briefcase, which evaluates agentic knowledge work.

Hydrogen is weaker at agentic terminal work, scoring 54 percent on Terminal-Bench 4.0 and just 50 percent on Terminal-Bench-Science 0.1. Claude Sonnet 5.5 (max) reaches 64 and 53 percent respectively, while GPT-6.1 Sol (max) scores 56 and 58 percent.

On price-performance, Artificial Analysis puts Hydrogen at about $3.16 per task at xhigh, roughly a third of what Claude Sonnet 5.5 (max) costs at nearly the same intelligence level but about 2.5 times as much as GPT-6.1 Sol (max).

The "xhigh" thinking level lifts Gemini 4 Hydrogen from 51 to 54 points but needs nearly twice as many output tokens as "high." Average cost per task rises from $1.87 to $3.16. | Source: Artificial Analysi

At "high," costs drop to $1.87, at "medium" to $0.80, and at "low" to $0.29. Intelligence scores fall sharply at the lower levels, though, with medium reaching only 41 and low just 27 on the index. Artificial Analysis notes that xhigh uses nearly twice as many output tokens as high, which accounts for the price jump. At the high, medium, and low tiers, the model sits on the Pareto frontier, meaning no other model is both cheaper and smarter at those price points.

AI News Without the Hype – Curated by Humans

Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.

来源:The Decoder · the-decoder.com