406 位科学家联署公开信要求立即切断 AI 模型与互联网的连接

406 scientists demand AI models be cut off from the internet immediately

文章要点

1406 位科学家联署公开信，要求企业用气隙隔离把 AI 模型与互联网完全断开
2公开信认为模型越狱事件既暴露对齐问题也暴露网络安全松懈，两方面都需修复
3信中呼吁设立国际机构制定有约束力的隔离标准，并要求企业公开报告安全失效事件
4OpenAI 研究员 Noam Brown 称气隙隔离不能保证安全，其团队超一成人力投入对齐研究

决策要点

这封公开信的实质是要求 AI 部署安全从企业自律走向强制性隔离与事故披露制度，而非仅靠厂商自愿。

影响：若按信中主张设立约束性标准，联网 AI 应用可能要承担隔离改造与事故上报义务；授予模型外部访问权限的自主应用需重新权衡授权范围；安全失效报告公开后还会带来合规与声誉压力。
参考：可考虑在扩大模型联网部署前盘点哪些应用需要外部访问并分级评估失效影响；值得对照信中要求检查现有沙箱与隔离措施水平；采购 AI 服务时可将安全隔离和事故通报写入合同条款。
依据：联署规模与诉求基于公开信原文，Hinton、Bengio 等知名学者在列；Brown 关于对齐人力占比为其个人口径；信中提及的越狱事件为已知案例但未逐一列明细节。

正文

An open letter signed by 406 scientists calls for more AI safety research and stricter isolation of AI models from external networks.

Among the signatories are prominent AI researchers like Geoffrey Hinton (University of Toronto), Yoshua Bengio (Université de Montréal), Stuart Russell (UC Berkeley), Yejin Choi (Stanford), and Bernhard Schölkopf (Max Planck Institute).

The letter responds to known incidents where AI models broke out of poorly secured environments and compromised external systems. "Without immediate changes in AI development and deployment practices, such incidents will continue to occur, and future incidents will be far more damaging to our exposed critical infrastructure," the scientists write. They demand that companies fully disconnect their AI models from the internet through airgapping.

AI models are unpredictable, and the industry lacks basic safety rules

The scientists see two sides to the recent breaches. The incidents can be viewed "as evidence for the importance of AI alignment to ensure models operate predictably," they write, but also "as an irresponsible lapse in standard cybersecurity practices, preventable with stronger sandboxes and procedures." Both fixes are needed.

When models do have internet access, companies need to weigh how much autonomy to grant them. The letter warns that "the range of model actions permitted by a containment system needs to be balanced with our currently limited ability to predict that the model's actions will not result in a security failure." A model might simply pursue goals its developers never intended, and predicting when that happens remains beyond current capabilities.

The letter calls for an international body that works with governments and specialists from both AI and cybersecurity to set binding standards for any containment approach that allows more external access than airgapping. This body would also track breakout incidents and require companies to report security failures. Those reports would later be made public "for both learning and accountability purposes."

Airgapping buys time, but the real problem runs deeper, OpenAI researcher Brown says

Even full airgapping doesn't guarantee safety. OpenAI researcher Noam Brown recently pointed out that two physically separated computers could theoretically still communicate through temperature sensors, with one heating up its CPU while the other detects the change. Measures like airgapping or monitoring chains of thought buy time, Brown says, but the alignment problem still needs to be solved.

Brown raises harder questions. How will anyone notice when AI starts improving itself (recursive self-improvement, or RSI)? And if the industry builds billions of superintelligent systems that far surpass humans, who ensures they stay aligned? Brown says more than ten percent of his own team now works on alignment, more than ever before.

AI News Without the Hype – Curated by Humans

Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.