跳到正文
原文
The Decoder:AI News· Matthias Bastian·· 13 天前AI 评分59

Mistral AI 发布 Voxtral 3 实时语音智能体方案,含转写、语音合成与 SDK

Mistral AI launches Voxtral 3, a full voice agent stack that listens, thinks, and talks in real time

文章要点
  • 1Mistral AI 发布 Voxtral 3 语音智能体系列,含转写、语音合成模型和基于 LiveKit 的 SDK。
  • 2转写覆盖超过 50 种语言,语音合成支持 35 种以上语言和 50 种方言,并带情感适应。
  • 3智能体可在实时通话中调用外部系统,例如预约或查询发票;转写定价从每分钟 $0.0035 起。
  • 4官方称系统可跑在自有基础设施或欧盟托管 API 上,让数据留在自己掌控范围内。
决策要点

Mistral 把实时语音智能体所需的转写、推理与语音合成打包成一整套栈,并把欧洲数据驻留作为差异化卖点。

  • 影响:搭建语音客服、预约或电话查询类服务可整体采用一套栈,不必分别拼装多家组件;对数据驻留有要求的欧洲业务多出自有部署和欧盟托管 API 两条路径;目前能力与成本数据均只有官方口径。
  • 参考:可考虑用预约或发票查询这类高频场景测算每分钟 $0.0035 的转写成本与人工对比;值得先评估自有部署与欧盟托管两种方式在合规边界和运维投入上的差别。
  • 依据:语言与方言覆盖、定价和部署方式均来自 Mistral 官方口径,暂无独立验证;SDK 基于 LiveKit 为文中明确信息。
正文

Mistral AI has launched Voxtral 3, a new family of language models built for real-time voice agents. The system includes a speech-to-text model (Voxtral Small Transcribe 3), a text-to-speech model (Voxtral Mini TTS 3), and a voice agent SDK based on LiveKit. Together, they combine listening, thinking, tool use, and speaking into a single streaming pipeline. Transcription covers more than 50 languages. Text-to-speech output supports over 35 languages and 50 dialects with emotional adaptation. Agents can tap into external systems during live conversations, for example, to book appointments or check invoices.

Mistral says the system can run on your own infrastructure or through EU-hosted APIs to keep data under your control. Pricing starts at $0.0035 per minute for transcription. More details are in the documentation.

AI News Without the Hype – Curated by Humans

Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.

来源:The Decoder:AI News · the-decoder.com