Perceptron 发布 Perceptron Egocentric 1.0,通过自助 API 提供第一人称视频标注,包含细粒度子任务、2D 和 3D 手部追踪,以及每只手和机器人夹爪上每个动作的独立时间线。
So much brilliant work is happening on robot training.
A lot of the cost in robot learning sits in labeling video, step by step and hand by hand. If that cost can be reduced by about 8x at nearly the same quality, much more of the footage teams already have can be used.
And now we also have proof that specialized model harnesses are closing in on general frontier models for narrow video tasks, at a fraction of the cost.
Upload a first-person video of someone doing chores, and we have an API returns each step with timestamps, what each hand is doing.
Perceptron AI's research shows, For labeling robot training video, paying 8x more for the biggest AI model buys you almost no extra accuracy.
A smaller system built only for this job gets the same result for the price of a sandwich per hour of video.
https://x.com/perceptroninc/status/2118018939708182843/video/1
Today we’re releasing Perceptron Egocentric 1.0: The frontier for egocentric annotations, now through a self-service API. • Fine-grained subtasks matching Astra quality at ~1/8 the cost • State-of-the-Art 2D and 3D hand tracking • Individual timelines for every action on each hand and robot gripper在 X 查看被引用的帖子
来源:Rohan Paul · x.com