推理云 Parasail 宣布将率先规模化部署 Positron 下一代 Titan 服务器,首期规模为 5MW。Titan 用普通智能手机式 DRAM 而非稀缺的 HBM 存放超大模型,单台服务器可承载最多 32 万亿参数的模型,作者认为每瓦内存容量正成为评判 AI 硬件最有用的指标之一。
Memory capacity per watt is becoming one of the most useful ways to judge AI hardware.
Positron Titan runs multi-trillion-parameter models on commodity DRAM, and @parasail_io is the first inference cloud putting it online at scale.
Parasail, an inference cloud that already runs several chip types behind one API, just announced it will be the first to deploy Positron’s next-gen Titan servers at scale, starting with 5MW.
Titan keeps giant models in cheap smartphone-style memory instead of scarce high-bandwidth memory (HBM), so one server can hold a model of up to 32 trillion parameters.
Positron's Titan is joining the Parasail fleet. 5MW. Trillions of tokens a day of cost-optimized compute by late 2027. @parasail_io @positron_ai @parasail_io is the first multi-silicon inference cloud that routes your prompts to the best chip for the job, serving trillions of tokens a day to hundreds of customers. Positron fills a vital part of compute spectrum on the cost optimized side: 4X better cost-per token than next gen NVIDIA/AMD systems which is perfect for large-scale agent swarms, background agents, and physical AI. Positron has done incredible work building a chip and system that orchestrates across DRAM and SRAM allowing for massively scalable memory pools with commodity memory giving the best of both worlds for memory capacity and bandwidth. We've been excited to partner with them in the early days through the launch of their Atlas chip and now big capacity plans with Titan. @positron_ai在 X 查看被引用的帖子
来源:Rohan Paul · x.com