DeepSeek 开源推理代码缩小昇腾与 Nvidia 芯片之间的差距
Open Inference Code Narrows the Gap Between Rival AI Chips
- 1DeepSeek 开源推理包把华为昇腾和 Nvidia 数据中心 GPU 列为同等构建目标,可在同一代码树间切换工作负载
- 2文章认为训练仍利好成熟软件生态,推理侧比拼延迟、每百万 token 成本与在线率,是替代芯片更可行的战场
- 3该发布定位为离线推理,未覆盖跨节点缓存管理、负载均衡等生产控制面;公开基准主要测于 Nvidia 硬件
- 4贸易报道称中国大型互联网公司仍在大量采购 Nvidia 芯片,Nvidia 也在推进面向自家 GPU 的服务层软件
此举把芯片选择从写服务代码前的架构绑定,推迟到按价格、供电和付费流量做采购决策,竞争焦点移向推理服务软件层。
- 影响:推理需求旺盛的运营方获得采购腾挪空间,可把价格、供货周期和政策约束放进同一套运营模型;训练侧生态差距未消,双路径更像对冲而非替代;硬件厂商会用自家服务软件回应,软件中立性未必长期维持。
- 参考:可考虑评估该开源包对现有 GPU 推理集群的适配与迁移成本;值得先算出本季度能买到、供上电并跑满付费流量的板卡清单,再决定试点场景。
- 依据:同等构建目标出自 DeepSeek 公开发布的设计;官方基准主要在 Nvidia 硬件测得,昇腾同条件对比数据公开渠道较少;Nvidia 采购情况为贸易报道口径。
NextFin News — Chip preference used to be decided before the first line of serving code was written. Teams planned around one vendor’s tools, then asked whether anything else could be made to work. An open inference package from DeepSeek tries to invert that order. Huawei’s Ascend processors and Nvidia’s current data-center GPUs are listed as peer build targets. The same project tree is meant to target both. In the published design, moving a workload between them is closer to flipping a configuration switch than forking the stack.
If that holds up under load, the practical question in Chinese machine rooms changes. Not “Can we port to domestic silicon?” but “Which board can we actually buy, power and fill with paying traffic this quarter?”
Serving is where that question bites. Training still favors deep, mature software ecosystems and tight multi-chip links; the incumbent’s lead there did not vanish with one repository. Inference is blunter. Weights are fixed. Users pay for tokens out the door. Latency, cost per million tokens, uptime and how fully the rack stays busy decide the winner. Alternative accelerators have long looked more plausible in that world than in the training cluster—provided the software stops treating them as afterthoughts.
DeepSeek’s release is aimed at that seam. By putting two hardware families in the same support tier, it lowers the tax on staying flexible when supply tightens. Trade reporting has described heavy ongoing purchases of Nvidia parts by large Chinese internet firms, including products pressed into AI duty beyond pure training SKUs. When deliveries slip, dual-path software is a hedge. New projects can weigh price, lead time and policy constraints inside one operational model instead of rebuilding the stack for each bet.

The marketing claim and the engineering proof are still different documents. Public benchmark tables tied to the release have leaned on Nvidia hardware. Side-by-side figures for Ascend on the same models, batch sizes and latency targets are thinner in the open. The company has also framed the drop as offline inference: useful for measurement and integration, not a full confession of every component a large production fleet needs—cache management across nodes, balancing, the unglamorous control plane. Compiling on two architectures is a start. Surviving peak traffic is the exam.
Incumbents are writing their own answers. Nvidia has been pushing open and semi-open serving layers tuned to its GPUs, iterating toward production-scale orchestration. A software story that equalizes backends invites a software response from the firm that still ships the most sought-after boards.
Further upstream, collaboration chatter around next-generation training chips—joint design work, engineers in the loop, hopes of less reliance on foreign supply—remains a longer cycle. Past rounds of “flagship model meets flagship domestic accelerator” taught the industry to wait for training-run results, not roadmaps.
For now the meaningful change sits in the serving layer. Chinese operators are drowning in demand for inference and negotiating for every available accelerator. Frameworks that refuse to hard-wire a single vendor into the architecture give procurement and platform teams room to maneuver. Whether Ascend occupies that room as a true peer will be settled by watts, milliseconds and invoices—not by the symmetry of a support matrix on a documentation page.
更多精彩内容,关注钛媒体微信号(ID:taimeiti),或者下载钛媒体App
来源:钛媒体 · tmtpost.com