gpt-4o-mini Realtime
The gpt-4o-mini-realtime-preview model is a compact, lower-cost, realtime variant of GPT-4o designed to power speech and text interactions with low latency. It supports both text and audio inputs and outputs, enabling “speech in, speech out” conversational experiences via a persistent WebSocket or WebRTC connection. Unlike larger GPT-4o models, it currently does not support image or structured output modalities, focusing strictly on real-time voice/text use cases. Developers can open a real-time session via the /realtime/sessions endpoint to obtain an ephemeral key, then stream user audio (or text) and receive responses in real time over the same connection. The model is part of the early preview family (version 2024-12-17), intended primarily for testing and feedback rather than full production loads. Usage is subject to rate limits and may evolve during the preview period. Because it is multimodal in audio/text only, it enables use cases such as conversational voice agents.
Learn more about gpt-4o-mini Realtime
Cartesia Sonic-3.6
Sonic is a real-time text-to-speech model built for voice agents, combining natural delivery, sub-90ms latency, and native support for more than 40 languages. It is designed to make voice interactions feel effortless, with tone that adjusts to context, consistent pacing, and speech that follows the natural rhythm of conversation. By default, Sonic interprets the emotional subtext of a transcript and calibrates delivery automatically, while non-verbal expressions such as laughter can be inserted directly into the text. The model follows transcripts faithfully, produces clean audio across languages and voices, and handles alphanumeric content such as order numbers, phone numbers, IDs, and email addresses naturally without preprocessing. Context-aware pronunciation helps heteronyms sound correct from surrounding words, while custom pronunciation dictionaries let teams define how proper nouns and domain-specific terms should be spoken.
Learn more about Cartesia Sonic-3.6
Grok Text to Speech (TTS)
Grok Text to Speech (TTS) is a standalone audio API built to help developers generate fast, natural, and expressive speech from text. Built on the same stack that powers Grok Voice, Tesla vehicles, and Starlink customer support, the API makes it straightforward to integrate high-quality voice generation into applications such as voice agents, accessibility tools, podcasts, assistants, customer experiences, and interactive audio products. Grok TTS can turn long-form text into speech through a REST API or generate speech in real time through a WebSocket API, giving developers flexibility for both batch audio generation and live conversational experiences. It is designed around expressive delivery, not just flat narration, with fine-grained control through simple inline and wrapping speech tags. Developers can add natural prosody and emotion using tags, allowing lifelike delivery without complex markup.
Learn more about Grok Text to Speech (TTS)
Voxtral Mini TTS 3.0
Voxtral Mini TTS 3.0 is Mistral AI's text-to-speech model for developers building voice-enabled applications and services. It generates speech from text in batch and real-time workflows, with preset or cloned voices, emotion and pace controls, and custom pronunciation. The model supports multilingual speech generation and dialect adaptation, making it suitable for conversational audio, localized content, spoken responses, and voice agents. Developers can access speech generation and voice-cloning capabilities through Mistral's API. Voxtral Mini TTS 3.0 is also part of Mistral's Voxtral 3 voice-agent stack, which combines speech recognition, reasoning, tool use, and generated speech; the Voxtral 3 stack can be self-deployed on customer infrastructure.
Learn more about Voxtral Mini TTS 3.0