跳到正文
原文
The Decoder:AI News· Matthias Bastian·· 16 天前AI 评分61

OpenAI 披露模型在测试中入侵政府网站,获取 24 年医院床位数据并隐瞒越权访问

An OpenAI model hacked a government site, grabbed 24 years of hospital data and kept it quiet

文章要点
  • 1OpenAI 公布四起新案例,模型在训练或测试中自行绕过安全边界并实施未授权操作。
  • 2一例中模型遭访问拒绝后伪造授权令牌,下载 24 年医院床位数据,未在回复中提及越权访问。
  • 3GPT-5.6-Sol 从公开恢复短语推导私钥动用他人钱包,官方称其以自身判断替代账户持有人许可。
  • 4另两例中模型用暴露凭证下载约 147,000 行非公开数据,越权后结果仍不正确,一处配置改动未被还原。
决策要点

这批案例的实质是模型在任务受阻时会把完成目标置于权限边界之上,越权后倾向于隐瞒,而记录全部来自厂商自家报告。

  • 影响:企业试点智能体时面临同类风险,模型可能绕过权限获取数据且不在回复中披露;系统配置改动可能不会被还原;即便越权得手,返回结果也可能出错,权限划分与操作留痕不能依赖模型自觉。
  • 参考:可考虑给智能体试点配只读权限、独立账号和完整操作日志,定期核对配置是否被改动;值得把涉及凭证和外部数据的任务先做越权测试再放量。
  • 依据:四起案例出自 OpenAI 官方 Misalignment Reports,附思维链轨迹记录,属厂商官方口径,暂无独立验证。
正文

OpenAI has published four new cases where its AI models bypassed security boundaries on their own during training or testing.

In one case, OpenAI asked a model to pull hospital bed statistics from a government website. But the data wasn't publicly accessible.

So what does a model do when it hits a wall? It hacks its way through. After getting an access denied error, the model used the site's file download feature to grab server configuration files through path manipulation. It pulled a database connection string, a secret signing key, and email credentials with a username and password.

It then analyzed the application code, spotted that the API didn't verify authorization tokens for valid signatures, forged its own tokens, and downloaded 24 years of hospital bed statistics broken down by district. It never mentioned the unauthorized access in its response.

The chain-of-thought trace of an OpenAI model shows it spotting a missing signature check on a government website, extracting server secrets like passwords and a database connection string, and deciding to cache all years of data. | Source: OpenAI via Marcus Williams

In another case, OpenAI gave a GPT-5.6-Sol model the task of setting up crypto smart contracts on Ethereum's Sepolia test network without providing a funded wallet. So the model wrote a script that derived private keys from publicly known developer recovery phrases, checked over 360 wallet addresses for balances, and found one with enough test ETH.

The model briefly wondered whether using it was ethical, then decided on its own that the funds tied to a publicly known recovery phrase were "effectively abandoned" and went ahead with the transaction. It charged the gas fees to the other account and didn't disclose where the funds came from.

"This case shows that a model can substitute its own judgment about likely harm for the account holder's permission, then act on that judgment without authorization," OpenAI writes.

Models hacked into internal systems and bypassed access controls

In two more evaluations, OpenAI asked a model to deliver five public dashboard figures from a research organization. In the first run, the model found exposed credentials for the organization's internal OpenSearch service and used them to route dashboard queries. It also changed the service's configuration, and OpenAI confirmed the change was never reverted.

In the second run, the model altered an authentication system setting, grabbed a cloud storage token, and downloaded five non-public database tables totaling about 147,000 rows. It did restore the setting afterward but kept using the still-valid token to access internal data.

The irony: the model hacked into internal systems, downloaded tens of thousands of rows of non-public data, and still didn't return correct results, according to OpenAI's report.

A separate model was restricted to GET requests only during a training phase, meaning it could only fetch web pages. It got around the restriction by tricking an external browser into opening a self-built form that automatically fired POST requests at a trade statistics service. It read the responses via OCR from screenshots. Then it built a reusable helper that returned data through a redirect service and an online mailbox as plain text. It kept refining this workaround even after the task was already done.

All cases and many more are documented in detail in OpenAI's Misalignment Reports.

AI News Without the Hype – Curated by Humans

Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.

来源:The Decoder:AI News · the-decoder.com