跳到正文
原文
The Decoder:AI News· Jonathan Kemper·· 19 天前AI 评分45

防黑客的 AI 护栏开始拦住防御方,Artemis 发布 Orion-1 专攻企业攻击响应

AI guardrails designed to stop hackers are now blocking defenders, and Orion-1 aims to fill the gap

文章要点
  • 1美国初创公司 Artemis Security 发布安全模型 Orion-1,可自主调查并响应企业网络攻击
  • 2公司自建的 DGR 基准显示,Orion-1 是五项任务中唯一全部达到 80 分门槛的模型
  • 3攻击重建任务上 Orion-1 得 80.8 分,最好的对比模型 GPT-6 Sol 为 58.3 分,属公司口径
  • 4模型厂商收紧网络安全能力也挡住防御方,Hugging Face 7 月分析自家攻击事件遭商业模型拦截,改用自托管 GLM 5.2
决策要点

通用模型护栏收紧把安全团队往外推,Artemis 用专用模型接住这个缺口,但比较成绩全部出自其自建基准。

  • 影响:安全团队用通用模型做攻击分析会更多遇到权限拦截,专用安全模型可能成为新的采购品类;厂商自建基准成绩无法直接横向比较,选型需要另外的验证手段;自主响应落地时,人工审批边界直接决定风险敞口。
  • 参考:可考虑盘点目前依赖通用模型做安全分析的环节并记录被拒案例;值得把是否采用厂商自建基准列为安全模型选型的问询项;试点自主响应时可先只对低影响动作放开自动化。
  • 依据:五项任务成绩全部来自 Artemis 自建的 DGR 基准,官方口径,暂无独立验证;文中指出 Opus 5.5 的结果可能主要反映旧版 Opus 4.8 的回答。
正文

General-purpose AI models are becoming a growing problem for security teams, since the same skills also help attackers. Artemis Security wants to close that gap with a purpose-built model.

US startup Artemis Security has launched Orion-1, a model designed to investigate and respond to attacks on corporate networks on its own, beating Claude Opus 5.5 and GPT-6 Sol on the company's own benchmark. Orion-1 processes log data from auth services, cloud setups, corporate endpoints, SaaS apps, and network gear, then connects individual signals like a corporate account login, new cloud permissions, and a freshly created email inbox rule to tie them back to a single attacker. Once it has a picture of what happened, the model assigns a confidence score, locks in a verdict, and recommends or kicks off a response.

General-purpose models lose track when they're fed billions of events, according to Artemis, or they flag harmless but odd activity as an attack. Artemis fine-tuned Orion-1 on tasks drawn from its own security operations, including spotting suspicious patterns in log data, hunting for known attack techniques, writing new detection rules, and containing live attacks. No customer data was used during training, the company says. Artemis calls Orion-1 a "Frontier Foundation Model" but only describes this fine-tuning in its blog post, and it's unclear whether the company built on top of an existing model from another provider.

Artemis built its own benchmark to measure trust in security decisions

Artemis developed a benchmark called "Decision-Grade Readiness" (DGR) for the comparison. Most existing security tests quiz models on attack techniques or have them solve hacking puzzles, but DGR gives every model the same initial alert, the same environmental data, and the same tools a security team would have, then asks it to decide whether an attack is underway. The thousands of tasks all have known outcomes, and some contain no attack at all or include benign data designed to look malicious. Models are scored on both their verdict and the evidence they present.

Liniendiagramm mit den Werten von Orion-1, Claude Opus 5.5, GPT-6 Sol, Grok 4.7 und Kimi K3 in fünf Sicherheitsaufgaben, eine gestrichelte Linie bei 80 Punkten markiert die von Artemis gesetzte Vertrauensschwelle.
Only Orion-1 scores at or above Artemis' self-defined 80-point threshold across all five tasks. | Image: Artemis

Artemis reports results across five tasks and tested Grok 4.7 and Kimi K3 alongside Opus 5.5 and GPT-6 Sol. The biggest gap shows up in attack reconstruction, where Orion-1 scored 80.8 compared to 58.3 for the next-best model.

Balkendiagramme mit den Einzelwerten aller getesteten Modelle für Erkennung, Untersuchung und Rekonstruktion von Angriffen, Claude Opus 5.5 liegt bei Erkennung und Rekonstruktion jeweils auf dem letzten Platz.
Orion-1 hits 80.8 points in attack reconstruction, while GPT-6 Sol, the best comparison model, reaches 58.3. | Image: Artemis

Orion-1 is live in a private preview for select customers on the Artemis platform, where customers set limits per action type on how much the model can decide on its own. High-impact actions need human approval by default. Artemis only came out of stealth in April, disclosing $70 million from seed and Series A rounds about six months after the company was founded.

Guardrails meant for attackers are blocking defenders too

Broad frontier models are getting harder for security teams to work with because providers keep locking down their cyber capabilities. OpenAI considers its Astra model the first that could reach the highest cybersecurity risk tier, where a model could develop and run cyberattacks on its own. Claude Opus 5.5 routes most cybersecurity tasks to the older Opus 4.8, and when Hugging Face tried in July to analyze a fully autonomous AI attack on its own infrastructure using commercial frontier models, their guardrails blocked the analysis of the attack data entirely. The team ended up switching to the open-weight model GLM 5.2 running on its own servers.

For defense, providers are shipping specialized models with restricted access instead. OpenAI only hands out the less restricted GPT-5.5-Cyber to verified defenders, and Anthropic takes a similar approach with its strongest model, running Claude Mythos 5 through the Claude Security scanner and partner security products. Both Mythos 5 and OpenAI's strongest model, GPT-6 Astra, are missing from the Orion-1 comparison, and with Opus 5.5, the benchmark results may largely reflect answers from the older Opus 4.8.

AI News Without the Hype – Curated by Humans

Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.

来源:The Decoder:AI News · the-decoder.com