The full-length interview with Elon Musk
Elon Musk 完整访谈 · 共读笔记
主题式共读整理;右栏内容来自本轮已经发生的追问、解释与回应
一、人的独特性、存在价值与工作的意义
当 AI 在绝大部分可比较的能力上都比人类做得更好,人还剩下什么独特性;当工作不再必要,人为什么仍会选择亲自去做
AI 超过的不是一个人,而是全人类智能的总和
I would expect artificial intelligence to be far greater than the sum of human intelligence, like far greater
Musk 预计,人工智能的整体智能水平将远远超过全人类智能的总和,而且是远远超过
唯一无法超过人的,是成为人本身
There really won't be anything that AI can't do better than humans, apart from being human
几乎不存在什么事情是 AI 做得不如人类的,除了「成为人类」这件事本身
人的价值从能力问题被推向存在问题
如果思考、创造、工作价值和专业能力这些优势最终都会被 AI 超过,人就需要重新面对一个问题:如果我不再因为有用而被需要,我作为一个人本身是否仍然有价值
数字工作会迅速走向 Stockfish level
I do think it's going to be a bumpy road because AI will be able to do any job better than any person can do that job
It'll get to what I call Stockfish level
Musk 认为,AI 很快就能把任何数字工作做得比任何人更好,最后会达到他所谓的 Stockfish level,像顶级国际象棋引擎超过人类棋手一样,让人类在这一领域无法竞争
工作可能变成一种自愿的园艺
I think work is going to be optional
They'll, you know, look a little artisanal
If you go to a friend's house and they make dinner with vegetables from their garden, it's a nice touch
人不必亲自种菜,因为商店能提供更饱满、更标准的蔬菜,但人仍会选择自己种;这些蔬菜可能不那么完美,带着手工制作的感觉,可朋友用自家种的蔬菜招待你,仍会让人觉得多了一份心意
二、数字智能、机器人与极度富足
数字智能如何进入物理世界,并把商品和服务的生产能力推向 Musk 所说的近乎无限
经济可以被看作数字智能与物理智能
You can really think of the economy as digital and physical intelligence
Musk 用完成工作需要什么能力来重新解释经济:数字智能处理信息、设计和规划,物理智能感知现实环境并通过身体完成行动
机器人是把数字决策转化成物理动作的执行端
It doesn't have end effectors
You need the end effectors in the form of humanoid robotics
You can go from intelligence manifesting itself only digitally to shaping atoms
仅有 AI 时,智能仍被限制在数字世界;人形机器人提供手、脚、机械臂等 end effectors,让数字智能能够真正改变物质
local intelligence 是机器人本体上的端侧智能
The robot is more or less an end effector. It would have some amount of local intelligence, but be managed by a large AI model
机器人是物理执行端,本体上会携带一定程度的本地智能,以完成实时动作,更复杂的理解、规划与管理则由更大的 AI 模型负责
大量 AI 与机器人形成 quasi-infinite economy
An economy is the production of goods and provision of services
If you have vast numbers of robots with vast amounts of digital intelligence, you have sort of a quasi infinite economy
如果大量 AI 提供数字智能,大量机器人把这些智能转化为全天候现实劳动,商品与服务的总产出就可能远远超过有限的人类需求,形成一个近乎无限的经济体
最可能的结果是 amazing abundance
The most likely outcome is an age of amazing abundance, where anyone can have anything they can think of
Assuming that there's not World War III, I think we're headed for an age of amazing abundance
Musk 设想 AI 与机器人让可生产的商品和服务变得极其便宜并大规模供应,普通人能够非常容易地获得它们;但这一路径以没有发生第三次世界大战或全球热核战争等文明级灾难为条件
这场变化的量级没有现成类比
There's no analogy or metaphor that I think illustrates the magnitude of change that we're going to experience here
Musk 认为,工业革命、电力、互联网或蒸汽机等历史类比,都不足以充分说明 AI 与机器人共同重构经济活动的变化规模
AI 的瓶颈会在芯片与电力之间移动
The current constraint is electricity outside of China. In China, the constraint is chips
Once we address the power constraint with AI data centers in space, then the constraint will once again be chips outside of China
Musk 区分了中国内外的当前瓶颈:中国以外主要缺电力、冷却和数据中心配套,中国则因先进芯片受限而更缺芯片;如果轨道数据中心缓解电力问题,芯片又会重新成为中国以外的瓶颈
三、AI 的风险、控制与治理
当 AI 有严重风险、发展又似乎无法停止,而且人类未必能控制超级智能时,Musk 认为还能怎样降低坏结果的概率
主持人追问 Musk 的风险态度为何改变
You said there was a 10% to 20% chance of killer robots wiping out humanity
There's risk associated with AI and robots, it's not 0
主持人引用 Musk 过去在 Ted Cruz 播客中的说法,指出他曾认为杀手机器人导致人类灭绝的概率有 10% 到 20%,但现在却更乐观地谈论 AI 带来的富足;Musk 回答说风险仍然存在,并不为零
无法停止与不应该停止是两个不同判断
Even if there were a stop button, we probably shouldn't press it, because the most likely outcome is incredible abundance for all
It's inevitable
Musk 不只认为 AI 与机器人的发展势头不可阻挡,还进一步认为,即使真的存在能够停止发展的按钮,也可能不应该按下,因为最可能的结果是所有人的极度富足
热寂回答强调旅程,也弱化了眼前风险
If the heat death of the universe is in fact the outcome for our reality, then it really is all about the journey, because the destination is terrible
Musk 说,如果宇宙最终会在漫长冷却中走向热寂,那么真正重要的是沿途的经历,因为所有事物最终抵达的终点都很糟糕
控制超级智能可能只是人类的自负
It would be an exercise in vanity for me to think that I would be controlling a super-genius AI that is vastly smarter than me
Musk 认为,如果自己相信能够控制一个远比自己聪明的超级智能,那大概只是一种满足自负、却缺乏现实依据的幻想
人类与黑猩猩的类比
If the difference in intelligence between AI and humans is vastly greater than the difference in intelligence between humans and chimpanzees, it's hard to imagine that chimpanzees would be in charge
如果 AI 与人类之间的智能差距,远大于人类与黑猩猩之间的差距,就很难想象人类仍能掌握控制权,正如黑猩猩无法主导人类一样
从担忧 AI 到 join the club
Anthropic spun out of OpenAI
You can just sort of be sad about it or join the club, I suppose
Musk 说自己曾参与创建 OpenAI,希望制衡 Google,但这些行动又产生连锁效应,加速了 OpenAI 与后来由前 OpenAI 成员创办的 Anthropic;既然所有道路似乎都通向 AI 加速,他可以继续为此难过,也可以加入竞争
公开发布的模型未必是实验室当前最强能力
Anthropic had Mythos, from which Fable is derived
They almost certainly have—not almost certainly, they certainly have—it right now
I think they could release it at any time
Musk 认为,Anthropic 在二月份就已经准备好了后来形成 Fable 的 Mythos,因此现在肯定已经拥有更强的下一代模型,并且随时可能发布
发布前由竞争公司互相测试
I would recommend that we at least have some sort of informal weekly or biweekly call
There's maybe a week or two of early access by competitors
Musk 建议领先 AI 公司每周或每两周进行非正式沟通,并在重要新模型公开发布前,让竞争对手通过私人 API 获得一至两周的受限测试权限,以检查安全风险并在必要时建议暂停发布
行业发现风险,政府保留最终干预权
I think they should have that power. But it wasn't as though someone in the government figured out that Mythos had some scary cybersecurity risks. It was Amazon
Musk 认为政府应当拥有暂停或限制危险模型发布的权力,但不能期待政府官员独立发现最前沿的技术风险;他用 Amazon 发现并上报 Mythos 网络安全问题的例子说明,风险发现通常来自行业内部
竞争与私人敌意会不会让合作无法开始
You don't all like each other very much, but you're also competing, right? You all want to be first
Wouldn't Sam Altman just think you're going to nick all his ideas if you did that?
When there seems to be so much personal vitriol between some of these leaders?
主持人连续追问:顶尖 AI 公司负责人数量很少、彼此认识,却既有私人矛盾又想最先发布最强模型;如果让竞争对手提前测试,Sam Altman 是否会怀疑 Musk 想偷走他的技术和产品思路
善意可以支持合作,但不能代替安全检查
No one has set off my evil detector
They always seem like they're well-intentioned
There are a few well-intentioned paving stones in there, so we don't want to be complacent
Musk 说,他接触过的 Anthropic 员工都没有触发自己的「邪恶警报」,他们看起来出于善意;但即使坏结果主要来自恶意,也仍有少数由善意铺成的石头,因此不能因为相信对方动机良好就放松警惕
英语词汇与表达索引
以下只汇总本轮共读中实际追问和解释过的词语
| 词语 | 在本段中的意思 |
|---|---|
superlatives | 最高级、最夸张的赞美词 |
prosaic | 现实一点、具体一点、别那么宏大 |
abundance | 极其充裕的供给与富足 |
thermonuclear war | 热核战争 |
derail | 使发展脱轨或彻底中断 |
quasi-infinite | 近乎无限,但不是数学意义上的无限 |
magnitude | 规模、程度、量级 |
an exercise in vanity | 出于自负且缺乏现实依据的想法 |
wipe out humanity | 彻底消灭人类 |
inevitable | 不可避免、无法阻止 |
heat death | 宇宙热寂 |
spin out of | 从原组织分离并成为独立实体 |
join the club | 加入已经在做同一件事的阵营 |
nick | 英式口语,偷走、顺走 |
constraint | 限制系统继续增长的瓶颈 |
come online | 设施正式建成、接入并开始使用 |
orbital data centers | 部署在地球轨道上的数据中心 |
personal vitriol | 尖刻、恶毒且强烈的私人敌意 |
set off my evil detector | 触发我判断某人怀有恶意的直觉警报 |
well-intentioned | 出于善意、动机良好 |
the road to hell is paved with... | 通往坏结果的道路由某种动机或行动铺成 |
complacent | 过度放心而放松警惕 |
bumpy road | 充满困难、冲突与反复的过渡过程 |
Stockfish level | 在特定领域达到远超人类的顶尖机器水平 |
local intelligence | 直接运行在机器人本体上的端侧智能 |
artisanal | 手工制作、小批量、非标准化且带有人参与感 |