swyx 指出 DeepSeek 在知乎发布的 DeepSeek V4.1 Flash 大规模推理部署文章信息量更大,而 X 上只发布了 DeepInfer 推理框架开源这一条。他引用文中数据称,单集群服务吞吐达 155 万亿 tokens/天,按低谷电价折算每卡每小时收入 38 美元;结合每 GPU 小时约 5-10 美元的成本,他认为 DeepSeek 按其定价可宣称约 80% 的服务毛利。
作者对比 DeepSeek 在知乎与 X 上披露的信息差异,并据此推算其推理服务的成本与毛利空间。
deepseek posted way more alpha on their zhihu page, if you only read twitter you are reading the laowai approved stuff
"Based on this framework, we have implemented a high-throughput, low-latency large-scale inference service for DeepSeek V4.1 Flash. Currently, the service throughput of a single cluster is 155 trillion tokens/day, and the overall revenue is $38 per card per hour (based on off-peak prices)."
it costs roughtly $5-10 per gpu hour so depseek is claiming 80% serving margin at THEIR prices lololololol
🚀 Introducing DeepInfer, our in-house inference framework, now fully open source! Powering DeepSeek-V4.1-Flash at scale with high throughput and low latency. We’re sharing our production stack to help the community lower compute costs, reduce energy use, and make AI more affordable. 🔗 http://github.com/deepseek-ai/DeepInfer 1/4在 X 查看被引用的帖子
来源:swyx · x.com