Amazon Nova 2 Sonic
Nova 2 Sonic is Amazon’s real-time speech-to-speech model designed to deliver natural, flowing voice interactions without relying on separate systems for text and audio. It combines speech recognition, speech generation, and text processing in a single model, enabling smooth, human-like conversations that can shift effortlessly between voice and text. With expanded multilingual support and expressive voice options, it produces responses that sound more lifelike and contextually aware. Its one-million-token context window allows for long, continuous interactions without losing track of prior details. It supports asynchronous task handling, meaning users can continue speaking, change topics, or ask follow-up questions while background tasks, such as searching for information or completing a request, continue uninterrupted. This makes voice experiences feel more fluid and less bound by traditional turn-based dialog constraints.
Learn more about Amazon Nova 2 Sonic
MAI-Transcribe-1.5
MAI-Transcribe-1.5 is Microsoft AI’s production-ready speech-to-text model for turning noisy audio into highly accurate, domain-aware transcripts across 43 languages. It delivers consistent, high-accuracy transcription across languages, accents, speaking styles, and challenging audio conditions, with automatic language detection included. The model is designed for real-world audio where speech often comes through conference rooms, phone lines, busy streets, low-quality recordings, background noise, and overlapping speakers. MAI-Transcribe-1.5 adapts transcription to domain-specific terminology, making it ready for captions, call analysis, accessibility, meeting transcription, doctor’s notes, pharma customer calls, content workflows, and other enterprise speech use cases out of the box. It uses contextual biasing to improve recognition of specialized vocabulary, names, industry language, and terms that generic transcription systems may miss.
Learn more about MAI-Transcribe-1.5
MAI-Transcribe-2
MAI-Transcribe-2 is Microsoft AI’s most capable transcription model yet, designed to deliver fast, accurate speech recognition across a broad range of real-world audio. It supports speaker diarization to distinguish speakers and attribute words to the right person, along with word-level timestamps for precise alignment, search, navigation, and editing. Keyword biasing helps recognize domain-specific terminology, abbreviations, names, and other terms that can be difficult to distinguish from context alone. Developers can choose between configurable transcription styles: a verbatim setting that preserves filler words and false starts for compliance and analysis, or a clean setting that removes fillers for more readable captions, notes, and published transcripts. The model supports code-switching for conversations that naturally move between languages, including blended language pairs such as Hinglish and Spanglish, and can automatically identify the language being spoken.
Learn more about MAI-Transcribe-2
OpenAI Realtime API
The OpenAI Realtime API is a newly introduced API, announced in 2024, that allows developers to create applications that facilitate real-time, low-latency interactions, such as speech-to-speech conversations. This API is designed for use cases like customer support agents, AI voice assistants, and language learning apps. Unlike previous implementations that required multiple models for speech recognition and text-to-speech conversion, the Realtime API handles these processes seamlessly in one call, enabling applications to handle voice interactions much faster and with more natural flow.
Learn more about OpenAI Realtime API