跳到正文

技术方向

数据与训练 最新动态

大模型是怎么练出来的:数据集构建、合成数据、预训练与后训练方法、算力与训练成本。

87 条精选近 30 天 73 条共收录 674 条

更新

精选归档 · 第 5 页

9月8日周二第 81–87 条
  1. Demis Hassabis78

    DeepMind 推出 AlphaGenome Atlas,这是一个可搜索的数据库,能预测全部 90 亿种可能的单碱基 DNA 变异带来的影响。Demis Hassabis 表示,继 AlphaFold 绘制蛋白质宇宙之后,该工具转向绘制人类基因组,帮助科学家更好地理解疾病,并已面向学术研究免费开放。

    引用Google DeepMind@GoogleDeepMind

    We’re launching AlphaGenome Atlas: an AI-powered searchable database mapping the predicted impact of all 9 billion possible single-letter DNA changes. Here’s how it could help researchers better understand our biology 🧵

    推荐理由:从 AlphaFold 到 AlphaGenome Atlas,读者能看到基因组变异预测工具如何面向学术研究开放。

9月6日周日
8月22日周六
6月18日周四
  1. Jim Fan80

    Jim Fan 介绍了 ENPIRE 在按下回车前必须完成的工程设计,包括两层安全机制、冻结奖励函数和系统遥测。安全上设置硬性运动学限制,机器人越界即任务失败并自动重置,同时用限扭力柔性夹爪让错误接触安全停住;奖励上先用少量成功与失败演示训练视觉分类器,再将其冻结为实时奖励函数。

    引用Jim Fan@DrJimFan

    Today, we enable AutoResearch in the physical world for the first time! Introducing ENPIRE: we give 8 Codex agents a fleet of robots, an allocation of GPUs, and generous token budget. We set them free with a simple goal: solve the task as quickly as possible, keep the robots busy but stay safe, don't waste precious compute. Make no mistake. Then humans step aside and our watch begins. The robot fleet starts to come alive: they learn to look for visual clues, reset the scene, practice novel skills, tinker with control stack, read papers online, debate, reflect, get stuck, and try again directly on the hardware. All we did is to give Codex an API to the world of atoms, and the rest is emergence. ENPIRE is able to solve high-precision tasks like tying zip-ties, organizing fine pins, and installing GPUs all by itself. We also discovered a new type of "physical scaling": 8 robots exploring in parallel improves significantly faster than fewer ones. A part of our NVIDIA GEAR lab now self-improves tirelessly over night. We just read the reports in the morning. /goal: we all take a holiday and Jensen wouldn't even notice ;) We will be open-sourcing everything, so you can host your self-running robot lab at home too! Deep dive in the thread:

    推荐理由:作者拆解了让 8 个 Codex 智能体自主运行机器人实验室前必须搭好的安全、奖励与遥测设计。

2月26日周四
2月25日周三