Nathan Lambert 发布其首场开源模型讲座,梳理构建开源模型生态的各个环节,以及决定其走向的开放问题与争论。讲座涵盖蒸馏如何融入、风险如何管理、未来模型获取方式将如何变化,并设有章节讨论什么算开源模型、顶尖开源模型的竞争力、人们是否真正在用开源模型。他表示计划每约 6 个月重访这些问题,给出该领域的状态综述。
My first open model lecture, covering all the many pieces that build the ecosystem, and the open questions/debates determining where it goes next.
How does distillation fit in?
How do we manage risks?
How do we see access to models changing in the future?
I'm excited to revisit these questions about every 6 months, to give a state of the union on the field.
Chapters
00:00 Introduction
01:36 What is an open model?
08:47 Why should we care about open models?
18:52 How competitive are the best open models today?
25:28 How are open models built? The role of distillation
34:52 Are people actually using open models?
41:47 What comes next with open models?
47:32 Conclusions
What questions did I not answer that you have?
来源:Nathan Lambert · x.com