🚨 AI News | TestingCatalog· @testingcatalog · X·· 4 天前AI 评分55
AI 导读
SGLang 现在可以在亚马逊 AWS Trainium 芯片上运行。此前它已支持 NVIDIA、AMD、Intel 和 Google 的芯片,让 AI 公司无需更换软件即可选择适配自身流水线的芯片。SGLang 负责接收每个请求、在芯片上运行模型并同时向多个用户返回结果,也能运行 FLUX、Wan2.2 等图像和视频模型。
正文 · 原文
SGLang now runs on Amazon's AWS Trainium chips. Top labs like Meta and Google use this open-source software to run AI models.
It already supports NVIDIA, AMD, Intel, and Google chips, letting AI companies choose the chip that best fits their pipeline without switching software.
SGLang takes each request, runs the model on the chips, and sends the answer back to many users at once. It can also run image and video models like FLUX and Wan2.2.
2,000+ people. Two days. The first SGLang Summit. Together, we announced SGLang v1.0, released Miles v0.2, and launched the SGLang Consortium with nine founding members: @nvidia, @AMD, @intel, @Google, @Meta, @thinkymachines, @Cloudflare, @modal, and @radixark. SGLang is now used by 332 organizations. At Meta, it powers production inference for products serving billions of users. Teams from Modal, Cloudflare, LinkedIn, and others shared their production lessons. Across 90+ technical talks and six hands-on workshops, the community explored what comes next for inference, reinforcement learning, and AI agents. To everyone building, deploying, and contributing: thank you for making this possible. Explore the announcements, engineering lessons, and moments from SGLang Summit 2026 in the link below.在 X 查看被引用的帖子
来源:🚨 AI News | TestingCatalog · x.com