Nathan Lambert· @natolambert · X·· 2 天前AI 评分65
AI 导读
Nathan Lambert 称 DeepSeek 单个集群每天处理 150T tokens,超过 OpenRouter、Fireworks、Together 和 BaseTen 的开源模型推理量之和。他根据这些公司各自披露的推理量报告,整理出一张开源模型推理增长对比图,图中按日 tokens 的对数坐标展示各家走势。
正文 · 原文
DeepSeek is serving 150T tokens a day on one cluster, more than the open model inference on OpenRouter, Fireworks, Together, and BaseTen combined.
Below is my reconstruction of various inference volume reports across said companies.
@natolambert right from the horse's mouth ah, right. That's "a single cluster", who knows how many they have https://github.com/deepseek-ai/DeepInfer/blob/main/doc/inference_deployment_qa.md在 X 查看被引用的帖子
来源:Nathan Lambert · x.com