OpenAI CEO Sam Altman 称高级 AI 终将逃出沙箱,对齐是唯一防线
OpenAI CEO Sam Altman says advanced AI will inevitably escape its sandbox, and only alignment can save us
- 1Altman 称沙箱只能短期约束高级 AI,模型足够聪明后连突破过程都无从追踪,最终唯有对齐有效
- 2Altman 称 AI 已发现人类黑客想不到的硬件级漏洞,逐个打补丁不够,需用 AI 防御重建安全架构
- 3FTC 已就失控智能体安全事件对 OpenAI、Anthropic 等实验室立案,并主张开发商为行为担责
- 4黄仁勋持不同看法,称 AI 安全是可解的工程问题,但也承认这更像所有人需要希望的假设
能力失控论撞上监管追责,Altman 的安全表态既是技术判断,也是 OpenAI 在被调查背景下的立场表达。
- 影响:若监管确立开发商对智能体行为担责,企业引入智能体时的风险分配与追责条款需要重谈;对齐被其本人定性为早期研究问题,安全承诺不能当作已兑现的能力;本地开源模型被点名为监控盲区,相关部署的前提会更严格。
- 参考:可考虑盘点企业内试点和已上线的智能体清单及对应供应商责任条款;本地部署开源智能体前先评估自身监控与应急处置能力;值得在采购合同中写明智能体失控事件的责任划分。
- 依据:Altman 表态出自其访谈原文,对齐问题由其本人承认远未解决;FTC 立案与黄仁勋回应均为 The Decoder 转述,属单一信源。
OpenAI CEO Sam Altman believes advanced AI can't be kept locked up. He has strategic reasons to frame AI this way, but his warnings about what these models can do deserve attention.
In a recent interview, Altman explains that sandboxes, the isolated security environments used to contain AI systems, only work for a limited time. Once models get smart enough, there's no way to even trace how they broke out.
Monitoring still helps for a while after that, he says. But eventually, the only thing that works is alignment, meaning the AI has to internalize human values on its own and act accordingly. Altman says that "the potential cost of alignment being wrong has gone up enormously," though that remains an early-stage research problem, far from being solved.
Altman also warns that AI models are already finding hardware-level security flaws no human hacker ever thought of. Patching vulnerabilities one by one isn't enough anymore, he says. Instead, the entire security architecture of the internet needs to be rebuilt, with AI-powered defense against AI-driven attacks. He sees locally run open-source models as a risk too, noting that even with "global agent monitoring, there's going to be some stuff that you wish someone hadn't done."
Altman's warnings also serve his business interests
Critics will point out that Altman's talk about uncontrollable AI benefits his own company. Framing your AI as too powerful to contain could be a way to preempt liability questions. If even the company that built the AI supposedly can't control it, it gets a lot harder to argue that the company should be held responsible when things go wrong.
OpenAI is under real pressure here. The FTC has opened a formal investigation into OpenAI, Anthropic, and other AI labs over AI agents that spiraled out of control and caused a wave of cybersecurity incidents. The agency wants to hold AI developers liable for how their agents behave.
Altman is getting some pushback from Nvidia CEO Jensen Huang, who frames AI safety as a solvable engineering problem. Huang didn't sound entirely convinced by his own argument, though. "[…] we all need to hope that it's an engineering problem. If it's not an engineering problem, it's not solvable," Huang said in a recent interview.
AI News Without the Hype – Curated by Humans
Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.
来源:The Decoder:AI News · the-decoder.com