微软 CEO 纳德拉称 AI 模型需要紧急制动
Microsoft’s Satya Nadella says AI models need an ‘emergency brake’
- 1微软 CEO 纳德拉在 X 发文，称是时候退一步评估 AI 的信任架构
- 2他主张把模型与编排其工作的 harness 分离，将控制与安全机制外部化
- 3他要求为每次有意义的模型动作留存防篡改的人类可读证据，授权人员可中途暂停或关闭模型
- 4他把这套思路比作紧急制动，称必须假设模型已被攻破并从一开始加以遏制
纳德拉提议的实质是不再默认模型可信，把安全重心从模型内部转向外部控制、审计与人工中断机制。
- 影响：企业采购 AI 时可把操作审计与人工中断能力列为明确要求；部署上宜按模型可能被攻破的假设设计权限与数据边界；多家头部 AI 公司公开承认疑似失控事件，说明内部治理不能只依赖厂商信用。
- 参考：可考虑把审计日志、防篡改证据与人工暂停开关写入 AI 采购和验收清单；值得按模型不可信的假设重新核定在用场景的权限边界，先盘点哪些场景缺少人工中断手段。
- 依据：判断依据为纳德拉本人在 X 的公开帖文及 TechCrunch 转述；文中失控事件与 Anthropic 开发计划为背景转述，尚无对应产品或监管动作。
In Brief
Posted:
2:47 PM PDT · October 10, 2026
Microsoft CEO Satya Nadella is the latest tech executive to offer lengthy thoughts on how AI safety might be improved.
In a Saturday morning post on X, Nadella wrote that it’s time “to step back and assess the trust architecture” of AI.
“We can’t treat Super Intelligence as a set of nested black boxes and simply accept or reject its recommendations, answers, and actions,” Nadella wrote, using the Trump administration’s preferred term for AI.
As outlined by Nadella, this approach “means separating the model from the harness that orchestrates its work,” as well as “externalizing controls and safeguards.” He also called for “every meaningful model action” to be documented with “tamper-proof human readable evidence,” and for systems where “an authorized person” always has the ability “to pause or shut down a model mid-task.”
“We must assume a model is compromised and contain it from the start,” he said. “Think of it like an emergency brake.”
Nadella’s comments come as leading AI companies acknowledge more and more incidents where they seemed to lose control of their models, and after Anthropic CEO Dario Amodei published a plan for more cautious AI development.
来源：TechCrunch · AI · techcrunch.com