Sam Altman 称内存放在数据中心比放在个人电脑更划算
Sam Altman says it’s better for RAM to be in a data center than on your desk
- 1Altman 称 DRAM 放在个人电脑仅 5% 时间被使用,供给紧张时应让云端实现最大利用率
- 2三星与 SK Hynix 已和云服务商及 OpenAI Stargate 等项目签下长期协议,锁定未来数年的大部分 RAM 产量
- 3云侧项目为芯片投入的巨额资金,是当前笔记本、手机等消费电子涨价的原因
- 4Altman 在 Cheeky Pint 播客回应 RAM 短缺话题,称许多人对本地推理的直觉与全球配置视角相反
Altman 的表态实质是为 AI 云优先占用内存供给辩护,个人电脑本地推理路线在硬件供应链上处于劣势。
- 影响:消费电子涨价会直接抬高企业换机与终端采购成本;本地部署模型所需的 DRAM 被云侧长约锁定,未来几年自建算力的内存获取空间收紧;资源进一步向头部 AI 项目集中。
- 参考:可考虑提前规划终端与服务器的内存采购预算并重算换机成本;有本地推理计划的团队值得测算云端方案做对照,并盘点现有设备的内存配置。
- 依据:三星与 SK Hynix 长期协议及涨价因果为 The Verge 转述报道;Altman 观点出自 Cheeky Pint 播客访谈,属个人立场。
Stevie Bonifield
is a news writer covering all things consumer tech. Stevie started out at Laptop Mag writing news and reviews on hardware, gaming, and AI.
Asked about supply chain shortages, like the ongoing RAM shortage, OpenAI CEO Sam Altman said in an interview that it’s “terrible” to have RAM in personal PCs instead of data centers. During his appearance on the Cheeky Pint podcast, where he also commented on AI’s impact on math, Altman said:
“A lot of people want local inference. And somehow, they assume that the problem is solved now because we are going to have open-source models, we’re going to be able to run them on our computers, and so we’re not going to need all the stuff in the data center.
But from a global allocation perspective, actually, it’s quite terrible to have everybody have a bunch of the world’s limited supply of DRAM sitting in their own computer and being used five percent of the time.
You want maximum utilization in the cloud if you’re trying to deal with this very supply constrained environment. And somehow everyone’s— many people’s intuition is the opposite of that.”
Whether Altman meant your gaming PC or developers working with something like the Surface RTX Spark Dev Box or the new touchscreen MacBook Pro, the outcome is the same. Right now, memory companies Samsung and SK Hynix have long term deals with cloud service operators and projects like OpenAI’s Stargate that have reserved much of the world’s RAM output over the next few years. And the billions they’re willing to lay out for chips is why the laptops, phones, and other tech you use are getting more expensive right now.
Follow topics and authors from this story to see more like this in your personalized homepage feed and to receive email updates.
- Stevie Bonifield
来源:The Verge · AI · theverge.com