跳到正文
Rohan Paul· @rohanpaul_ai · X·· 20 小时前同事件AI 评分78
AI 导读

Meta 向所有美国用户开放与 Muse AI 智能体的实时视频通话,通话中会显示可自定义为人物、动物等形象的动态虚拟形象,并在聆听时做出反应。

同一件事,精选收录的是《Meta 向美国用户开放 Muse 实时语音与动态虚拟形象》

正文 · 原文

Meta just opened live video calls with its Muse AI agent to every US user.

Callers see an animated avatar they can restyle as a person, animal or other character, and it reacts while listening.

Muse Realtime Voice emits speech tokens carrying words and delivery, and Muse Realtime Avatar turns the same stream into lip-synced video.

To run that live, Meta trained a student model to reproduce in 2 passes per video chunk what a teacher built in 120.

the system streams 448x768 portrait video at 25 frames per second and starts replying about 870ms after a user stops talking.

Adding 4-bit quantization, caching and dynamic batching lets a single Nvidia GB200 run 12 video streams at once.

In company-run tests of 2- to 3-minute calls, raters preferred the avatar to Runway Characters 78% to 22% and HeyGen LiveAvatar 88% to 12%.

At 12 streams per GB200, 1M simultaneous callers would need about 83K of them for video alone, so serving cost could cap the avatar’s reach.

来源:Rohan Paul · x.com