跳到正文
原文
The Verge · AI· Hayden Field·· 23 天前AI 评分63

AI 智能体厂商竞相承诺隐私保护,OpenAI 与 Meta 能否兑现

AI agent makers are promising privacy — will they deliver?

文章要点
  • 1OpenAI 在 DevDay 发布智能体 Dots,Altman 称要为前沿 AI 的隐私设定新标准
  • 2Meta 的 Muse 曾承诺从零开始为隐私打造,但 Meta 自己仍可访问用户数据,上线后曝出零日漏洞(已修复)
  • 3Muse 上线数周在美国获 60 万日活(Apptopia 口径),且默认允许 Meta 用用户数据训练模型
  • 4OpenAI 向企业客户提供零数据保留等更强控制选项,Dots 仅限 $100 及以上 ChatGPT 订阅档位
决策要点

隐私承诺已成为智能体厂商互相攻击的竞争筹码,但两家产品的实际数据行为尚未完全支撑这些承诺。

  • 影响:智能体需读取大量个人与企业数据才能工作,默认训练授权可能让输入内容进入厂商模型;数据边界模糊会放大泄露风险;隐私能力正成为厂商争夺企业客户的卖点。
  • 参考:可考虑在试点智能体前逐项核对默认训练开关与数据访问范围并关闭非必要授权;值得把零数据保留、加密验证访问等条款纳入采购要求;先盘点业务场景需要开放哪些内部数据。
  • 依据:Muse 日活数据来自 Apptopia,零日漏洞经安全研究员曝光后已修复,内部数据库隐患出自 404 Media;OpenAI 的隐私能力为官方口径,暂无独立验证。
正文

At this year’s OpenAI DevDay, CEO Sam Altman unveiled the company’s new AI agent Dots — and told the crowd that the company wants to “set a new standard for privacy in frontier AI.” OpenAI would spend the day taking veiled shots at Meta’s Muse, its primary competitor, for failing to keep users’ data safe. Yet Muse itself, a couple of months earlier, had launched as a supposedly safer alternative to predecessor OpenClaw — with CEO Mark Zuckerberg promising it was “built from the ground up for privacy and security.”

In an age when companies hoard customers’ personal data and cyberattacks are a dime a dozen, AI labs are trying to convince users to share even more information with their agents. Their latest strategy for success is one-upping the competition by promising that unlike their rivals, they’ll keep user data away from prying eyes. The question is whether companies can keep these promises.

Nat Friedman, head of product at Meta Superintelligence Labs, wrote on X that the company’s “goal with muse was to build something like openclaw that we could make safe and secure and easy to use and scale to billions of people.” User data is stored on a secure VM, what Zuckerberg described as an “isolated linux computer with a browser, CPU, memory, and storage.” The company said that most of the effort in building Muse was related to “careful design and engineering to operate [it] more safely.” Meta’s blog post continued, “Muse can and will still make mistakes, but we expect they’ll be much less frequent and cause much less damage due to the safety systems we’ve built in.”

But though Muse topped the App Store charts and, per Apptopia, gained 600,000 daily active users in the US within weeks, Meta’s promises seem to have fallen short. Although data is isolated from other users, and the company plans to introduce a way “to cryptographically and verifiably prevent Meta from accessing data in your VM” later this year, Meta itself can still access the data. A security researcher quickly exposed a zero-day vulnerability that could allow someone to take control of Muse (which has since been patched), raising fears of outside attacks. Multiple serious security issues reportedly cropped up at the last minute before launch, one of which could have allowed users to access Meta’s own internal databases, per 404 Media.

Muse also appears to liberally collect (and in some cases, hand out) data. It defaults to allowing Meta to train models on what users put into it, though it’s possible to opt out. An Inc. reporter complained that Muse uploaded and read his private messages without him asking it to, and a YouTuber said it had offered his address to a stranger via Marketplace — in both cases, Muse was functioning apparently as intended, but the user didn’t realize how far it would go. The platform creates “detailed profiles of all your friends and family,” as Wired reported. None of this is necessarily unexpected from Meta, but it certainly doesn’t back up the idea that Muse is uniquely privacy- or security-conscious.

OpenAI seized on this fact when announcing Dots in late September. Alexander Embiricos, OpenAI’s Codex product lead, said onstage at DevDay that OpenAI is focused on having the “most trustworthy, safe, and secure assistant,” and CEO Sam Altman demonstrated ways that people could exert control over their individual Dots, such as setting a rule that it should never make a purchase over a certain dollar amount. “I think we’re in a different position to Meta in that they don’t have an AI product that has 1.2 billion users,” said Glen Coates, OpenAI’s head of app platform, adding that “launching something that makes those kinds of mistakes is something that we would try to take the care to avoid.”

Altman himself also pushed the privacy angle at DevDay. To court business customers, executives presented a framework allowing enterprises to have “stronger controls” over their data and zero data retention policy options (meaning no data is stored on OpenAI servers). Indeed, so far, there haven’t been many privacy scandals with Dots — although since it’s only available on the $100-and-up ChatGPT subscription tiers, there are also likely fewer people using it.

People may still not feel comfortable giving OpenAI their personal data, in part simply because AI agents require so much of it. For instance, The Verge’s Allison Johnson felt uncomfortable typing in her bank information when the bot asked as part of a relevant task (Muse has a Stripe integration to take care of that).

Not all companies are making privacy promises, of course. Instinct was publicly criticized for reportedly overly-broad terms of service that gave it unfettered access to data; since then, the company seems to have made adjustments. For now, AI labs seem to be counting on a three-part approach to popularizing AI agent use with the general public: Make them useful, make them cute and disarming to help offset the creepiness, and make promises about privacy — and hope they hold up.

Follow topics and authors from this story to see more like this in your personalized homepage feed and to receive email updates.

  • Hayden Field

来源:The Verge · AI · theverge.com