小米 MiMo 与 TileRT 合作发布 MiMo-V2.5-Pro-UltraSpeed,在 1 万亿参数 MoE 模型上实现 1000 tokens/s 以上的输出速度。
官方给出 1T MoE 模型在单台标准 8-GPGPU 节点上突破 1000 tokens/s 的部署路径,可与 Cerebras、Groq 方案对照。
🚀 1,000+ TOKENS/S ON A 1T MODEL! 🚀
We are thrilled to release Xiaomi MiMo-V2.5-Pro-UltraSpeed in collaboration with @TileRT_AI , breaking the 1,000 tokens/s output speed on a 1 Trillion parameter model for the FIRST TIME!
Not wafer-scale integration like Cerebras. Not pure on-chip SRAM chips like Groq. We achieve 1,000 tps on a 1T MoE model using just a SINGLE, STANDARD 8-GPGPU NODE.
Read the full technical deep dive:https://mimo.xiaomi.com/blog/mimo-tilert-1000tps
Want to experience the future of real-time AI?
👉 Apply for UltraSpeed now: https://platform.xiaomimimo.com/ultraspeed
⏳ Limited-Time Access: Application-based · Jun 8 – Jun 23 (PDT)
💬 Chat Experience: Completely FREE for a limited time — try the blazing-fast web chat now.
⚡ UltraSpeed API: Just 3x the price for a ~10x boost in output experience.
🤝 Enterprise & Large-Scale Needs: business-mimo@xiaomi.com
来源:Xiaomi MiMo · x.com