跳到正文
elvis· @omarsar0 · X·· 3 小时前AI 评分38
AI 导读

Superlinked 的 SIE 用一个 API 接入智能体各步骤所需的开源模型,14 项任务测试中开源模型在 SIE 上达到 GPT-6.1 Sol 中位分数 98%,成本仅为其 3%(按标价)。其背景是 SIE Serverless 托管推理产品发布,面向小模型,覆盖 Search、OCR 和智能体执行等 20 多个任务场景。建议把前沿模型留给需要复杂推理的步骤。

正文 · 原文

Stop overpaying for agents, folks!

A single agent request can trigger many model calls. Your agent might classify a ticket, rerank results, extract a date and run a guardrail before it ever answers.

Sending all of those calls to a frontier model gets expensive fast. And it’s unnecessary.

@superlinked SIE gives you one API for the open models behind those steps.

Across 14 task tests, open models on SIE reached a median 98% of GPT-6.1 Sol's score at 3% of its cost, at list pricing.

Keep the frontier model for the steps that need it, like those requiring complex reasoning.

引用Daniel Svonava@svonava
🚨 Huge news 🚨 today we are launching SIE Serverless - a managed inference product focused on small models. It’s useful for spiky workloads on 20+ task specific workloads across Search, OCR and Agentic execution. Sign up for a $500 credits launch grant 👇 It’s powered by our open source inference engine that has received thousands of github stars in the last few months, battle-tested across finance, legal & tech. We believe that self-hosting is going to be critical given all the trust & security issues in AI, but practically there are always workloads where you’d like somebody else to deal with the GPU quota like synthetic data generation, evals, public research and beyond. The team at Superlinked has been burning the midnight oil for months and I’m so proud of every single one of you - what a privilege to call you my team mates y’all! We built it, now help us make some noise 🙌 A like, a comment or a repost would mean a lot! ❤️
在 X 查看被引用的帖子

来源:elvis · x.com