Ultravox

Ultravox: The Next-Gen Voice AI Platform

Ultravox is a cutting-edge Voice AI platform built for scale, designed to facilitate human-like conversations with minimal ASR lag, a streamlined vendor chain, and no loss of reasoning. Starting at just $0.05 per minute, Ultravox offers an accessible and powerful solution for enterprises and innovators seeking to leverage the potential of AI-driven speech understanding.

What is Ultravox?

Ultravox is an open-weight Speech Language Model (SLM) trained to understand speech as naturally as humans do. By directly integrating speech recognition, Ultravox bypasses the traditional process of converting speech to text, leading to faster, more reliable, and more natural interactions.

How does Ultravox work?

Unlike legacy component systems that rely on cascaded pipelines of services, Ultravox directly understands speech. This streamlined approach reduces latency and cost, making it a superior solution for real-time voice applications.

Key features and benefits include:

• Reduced Stack, Reduced Friction: By eliminating components of traditional voice systems, Ultravox minimizes latency and cost.
• Fast, Accurate, Smart: Ultravox integrates speech recognition directly, without converting speech to text, making it faster, more reliable, and more natural.
• Build Quickly & Intuitively: Users can create agents with real-world capabilities, upload documents for RAG (Retrieval-Augmented Generation), and track everything in the console.
• Scale Fast When You’re Ready: The platform controls the entire stack, ensuring the reliability and availability of systems.

Why choose Ultravox?

Choosing Ultravox provides numerous advantages over traditional voice-based systems:

• Speed: Direct speech understanding results in significantly faster response times compared to legacy component systems.
• Reliability: Fewer moving parts translate to more consistent performance and reduced potential for failure.
• Natural Interaction: Ultravox captures the nuances of human speech, offering a more seamless and engaging user experience.

Who is Ultravox for?

Ultravox is designed for enterprises and innovators across various industries who seek to implement scalable, efficient, and natural voice AI solutions. It is suitable for:

• Businesses looking to enhance customer service through AI-powered voice assistants.
• Developers building real-time voice applications requiring low latency and high reliability.
• Organizations seeking to streamline their vendor chain and reduce costs associated with voice AI infrastructure.

Ultravox Benchmarks

Ultravox's performance is evaluated using zero-shot speech translation, measured by BLEU, as a proxy for general instruction-following capability. The higher the BLEU score, the better the performance. The benchmark results demonstrate Ultravox's competitive edge in speech translation:

• Ultravox 0.5 70B: 35.7 BLEU
• GPT-4o REALTIME: 34.6 BLEU
• Gemini 1.5 Flash 002: 33.0 BLEU

Ultravox Pricing Plans

Ultravox offers flexible pricing plans to accommodate various needs:

• Pay as You Go: Perfect for experimentation, offering 30 minutes of free calls and $0.05 per minute after that, with no surge pricing and unlimited playground calls. Up to 5 concurrent calls are supported.
• Pro: Ideal for scaling a Voice AI business, the Pro plan removes hard caps on concurrency and includes outbound call scheduler, 5 custom voices, and 20 corpora for RAG.
• Enterprise: Designed for massive scale, the Enterprise plan offers priority SLA, org support, and customizable features.

How to use Ultravox?

1. Sign Up: Visit the Ultravox website and create an account.
2. Explore the Console: Familiarize yourself with the console, where you can create agents, upload documents for RAG, and track performance.
3. Try a Demo: Interact with Ultravox to experience its human-like conversation capabilities firsthand.
4. Choose a Plan: Select a pricing plan that aligns with your needs and scale requirements.
5. Integrate & Deploy: Integrate Ultravox into your applications and deploy your voice AI solutions.

In summary, Ultravox is a Voice AI platform providing human-like conversations, reduced latency, and cost-effective scaling. With its innovative approach to speech understanding and flexible pricing plans, Ultravox empowers businesses and developers to harness the power of AI-driven voice technology.