微软CEO纳德拉称应假设所有AI模型都已被攻陷,并呼吁设置紧急制动机制
Satya Nadella says we should assume all AI models are ‘compromised’
- 1微软CEO纳德拉在X发文,称必须假设AI模型已被攻陷,并从一开始就加以遏制
- 2他提出紧急制动机制,授权人员应能随时中途暂停或关闭模型,更先进模型需标准化的遏制技术
- 3他主张AI不能再被视为嵌套黑箱,系统需可容纳、可观察并留下防篡改的人类可读证据
- 4及时事件披露、独立审计、可验证数据等建议与业界已有声音一致
纳德拉把安全领域假设已被攻陷的思路搬到模型治理上,多数建议与业界已有呼声趋同,重点落在遏制与紧急制动。
- 影响:若供应商采纳这一主张,企业选型和部署评估可能新增独立审计、事件披露与随时中止模型等要求;同时使用多个模型时需为隔离与监控预留架构和人力;遏制技术目前没有统一标准。
- 参考:可考虑在AI采购与部署要求中加入中止开关、审计日志和事件披露条款;值得盘点现有模型应用里谁有权暂停服务、运行是否留痕,先找出与可遏制目标的差距。
- 依据:纳德拉的表态来自其在X发布的长文,属个人主张,暂无独立验证;The Verge转述称其余建议与业界已有声音一致。
Microsoft’s CEO calls for putting an ‘emergency brake’ on AI.
Microsoft’s CEO calls for putting an ‘emergency brake’ on AI.
by Terrence O'Brien
Oct 10, 2026, 10:10 PM UTC


Image: Cath Virginia / The Verge, Getty Images
Terrence O'Brien
is the Verge’s weekend editor. He’s covered the tech industry for over 18 years and knows a thing or two about synths.
In a lengthy post on X, Microsoft’s CEO laid out his views on the dangers posed by highly advanced AI models and how to confront those risks. Nadella says we can no longer accept a world where AI is treated as a “set of nested black boxes” whose advice and actions we simply accept or reject. He calls for building a more transparent system where models can be contained, observed, and leaves behind “tamper-proof human readable evidence.”
Many of his recommendations align with what we’ve heard from others in the industry: timely incident disclosure, independent audits, verifiable data, and containment. It’s on that last point that he appears to go slightly farther than some others in the field, saying:
We must assume a model is compromised and contain it from the start. Think of it like an emergency brake. An authorized person should always be able to pause or shut down a model mid-task. More advanced models will require more advanced containment technologies that we need to standardize on.
Unfortunately, Nadella also refers to AI as “super intelligence” throughout the post.
Follow topics and authors from this story to see more like this in your personalized homepage feed and to receive email updates.
- Terrence O'Brien
来源:The Verge · AI · theverge.com