跳到正文
原文
The Decoder:AI News· Maximilian Schreiner·· 3 小时前AI 评分62

ElevenLabs 发布 Scribe v3 与 Scribe v3 Live,实时版借对话语境避免截断来电语句

ElevenLabs Scribe v3 Live uses conversational context to stop voice agents from cutting off callers mid-sentence

文章要点
  • 1ElevenLabs 发布 Scribe v3 与 Scribe v3 Live 语音转文本模型,Live 版主打低延迟实时语音智能体场景
  • 2官方称 Scribe v3 在 102 种语言上词错误率较前代降低约 25%,德语准确度显著提升
  • 3Artificial Analysis 独立评测显示其准确率领先微软、Mistral、xAI、Google、OpenAI,仅次阿里预览模型,但速度偏慢
  • 4Scribe v3 Live 分析对话语境判断说话是否结束,替代固定停顿计时,避免来电者语句被截断
决策要点

这次发布的实质是语音识别竞争从单纯准确率转向实时对话判断,但独立数据表明高准确率伴随速度与价格代价。

  • 影响:客服与外呼类语音智能体可减少误判停顿导致的截断;大批量转写场景下微软与 xAI 模型速度更快、价格约低一半,成本敏感方需另行比较;欧盟隔离服务器与零保留模式降低受监管行业的部署门槛。
  • 参考:可考虑先测算自身通话量下的错误成本与转写费用差距,再决定实时语音智能体是否选用 Scribe v3 Live;值得预载品牌名与专业术语清单做小样本对比测试,并核对零保留模式的合规条款。
  • 依据:准确率领先结论来自 Artificial Analysis 独立评测;25% 错误率降幅与德语提升为官方口径,暂无独立验证;速度与价格对比出自同一基准测试。
正文

Elevenlabs updates its speech recognition for recorded conversations and real-time use. Independent benchmarks confirm high accuracy but also show drawbacks in speed.

Elevenlabs has released two new speech-to-text models, Scribe v3 and Scribe v3 Live, built for messy conditions such as people talking over each other in meetings or phone calls with background noise.

Scribe v3 is designed for pre-recorded audio files, while Scribe v3 Live targets low-latency real-time applications. Both models are available now through the ElevenAPI developer interface and the ElevenAgents platform.

According to Elevenlabs, Scribe v3 cuts word errors by about 25 percent compared to its predecessor across 102 languages, and the company says German accuracy improves significantly. Speaker diarization also works more reliably in larger group conversations, according to the company, and Scribe v3 Live makes it available in real time for the first time.

Scribe v3 leads on accuracy but is slower and pricier than rivals

Independent benchmarks from Artificial Analysis confirm that Scribe v3 is among the most accurate transcription models on the market. It edges out competitors from Microsoft, Mistral, xAI, Google, and OpenAI, trailing only a preview model from Alibaba.

Scribe v3 is the most accurate model in the Artificial Analysis test but lags somewhat in speed. Its benchmark price is $3.33 per 1,000 minutes (not shown).

Anyone looking to process large volumes of audio quickly and cheaply is better off with other providers, though. Elevenlabs lands mid-pack on speed and price. Models from Microsoft and xAI run many times faster at marginally higher error rates and cost roughly half as much.

However, the benchmark measures only word errors on recorded files. It doesn't account for the improvements Elevenlabs touts in speaker diarization, rare languages, or the real-time behavior of Scribe v3 Live.

Scribe v3 Live aims to keep voice agents from cutting off callers

In voice agents, Scribe v3 Live is meant to fix a flaw in current systems, which often rely on rigid pause timers and cut callers off mid-sentence when they stop briefly to think or slowly read out a string of numbers. The new real-time model analyzes conversational context alongside the audio signal so it can tell when a speaker has actually finished.

Elevenlabs also gives developers more control over the final transcript. The models can be preloaded with thousands of specialized terms like brand names or medications to avoid mishearing domain-specific vocabulary. Developers can set formatting rules for numbers or dates in natural language, and a multilingual mode handles language switches mid-sentence. Enterprise customers get isolated servers in the EU and a zero-retention mode designed to delete data immediately after each request.

Elevenlabs is also expanding its enterprise business alongside the new models. Under an expanded partnership with Nvidia, the company is integrating the open Nemotron 3.5 Super VL language model into ElevenAgents, securing additional compute capacity running on Nvidia, developing local voice control for robots, and running a phone agent for Poland's public health system. The company also announced an alliance with consulting firm McKinsey, a broader partner program for system integrators, and its own marketplace where companies like Salesforce, IBM, and Zendesk offer ready-made voice agents.

AI News Without the Hype – Curated by Humans

Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.

来源:The Decoder:AI News · the-decoder.com