跳到正文
Nathan Lambert· @natolambert · X·· 2 天前AI 评分65
AI 导读

Nathan Lambert 称 DeepSeek 单个集群每天处理 150T tokens,超过 OpenRouter、Fireworks、Together 和 BaseTen 的开源模型推理量之和。他根据这些公司各自披露的推理量报告,整理出一张开源模型推理增长对比图,图中按日 tokens 的对数坐标展示各家走势。

正文 · 原文

DeepSeek is serving 150T tokens a day on one cluster, more than the open model inference on OpenRouter, Fireworks, Together, and BaseTen combined.

Below is my reconstruction of various inference volume reports across said companies.

引用Teortaxes▶️ (DeepSeek 推特🐋铁粉 2023 – ∞)@teortaxesTex
@natolambert right from the horse's mouth ah, right. That's "a single cluster", who knows how many they have https://github.com/deepseek-ai/DeepInfer/blob/main/doc/inference_deployment_qa.md
在 X 查看被引用的帖子

来源:Nathan Lambert · x.com