百度发布并开源 Unlimited OCR 2,其 SR-SWA 机制将文本与视觉的注意力交互压缩为固定规模的工作参考集。官方称该模型可在有限上下文窗口内解析任意长度文档,文档变长时单步解码延迟和内存占用接近恒定,并在覆盖数十至数百页文档的 MPDocBench 和 MarathonDocBench 上取得 SOTA 表现。
Unlimited OCR 2 is here, and it's open source. 📖 ✨
Longer documents can mean a lot more attention computation. Our new SR-SWA mechanism keeps that in check by condensing text-visual attention interactions into a fixed-size set of working references.
Here's what it delivers:
- Document parsing at virtually any length, within a finite context window
- Nearly constant per-step decoding latency and memory footprint as documents grow longer
- State-of-the-art performance on MPDocBench and MarathonDocBench, covering documents from dozens to hundreds of pages
Check out the model here ↓
来源:Baidu Inc. · x.com