Google DeepMind 发布 Genie 4,这是其首个带原生音频的实时世界模型,可生成环境音、音乐和角色实时对话,角色会对用户和场景内事件做出反应。用户可通过输入文字改写运行中的模拟,例如改变天气、移动镜头或添加人物,Gemini 负责让每次编辑贴合场景并保持连贯。
同一件事,精选收录的是《Google DeepMind 发布世界模型 Genie 4》
Genie 4 is Google DeepMind’s first real-time world model with native audio, generating ambient sound, music and live dialogue from characters who react to users and in-world events.
Users can rewrite a running simulation by typing, changing weather, moving the camera or adding people, while Gemini fits each edit to the scene and keeps it coherent.
Gemini 3.8 Flash acts as an in-loop director, splitting goals into steps and checking incoming frames, and Gemini 4 Argon used that loop to simulate Apptronik’s Apollo humanoid playing checkers.
access starts with trusted testers before Google AI Ultra subscribers and early Gemini API partners. https://x.com/sundarpichai/status/2115115252690145519/video/1
来源:Rohan Paul · x.com