Announcing HAQM Nova Sonic, a new speech-to-speech model that brings real-time voice conversations to HAQM Bedrock
Today, HAQM introduces HAQM Nova Sonic, a new foundation model that unifies speech understanding and generation into a single model, to enable human-like voice conversations in artificial intelligence (AI) applications. HAQM Nova Sonic enables developers to build real-time conversational AI applications in HAQM Bedrock, with industry-leading price performance and low latency. It can understand speech in different speaking styles and generate speech in expressive voices, including both masculine-sounding and feminine-sounding voices, in English accents including American and British. HAQM Nova Sonic's novel architecture can adapt the intonation, prosody, and style of the generated speech response to align with the context and content of the speech input. Additionally, HAQM Nova Sonic allows for function calling and knowledge grounding with enterprise data using Retrieval-Augmented Generation (RAG). HAQM Nova Sonic is developed with responsible AI in mind and features built-in protections including content moderation and watermarking.
To help developers build real-time application with HAQM Nova Sonic, AWS is also announcing the launch of a new bidirectional streaming API in HAQM Bedrock. This API enables two-way streaming of content, which is critical for low latency interactive communication between a human user and the AI model.
HAQM Nova Sonic can be used to voice-enable virtually any application. It has been extensively tested for a wide range of applications, including enabling customer service call automation at contact centers, outbound marketing, voice-enabled personal assistants and agents, and interactive education and language learning.
The HAQM Nova Sonic model is now available in HAQM Bedrock in the US East (N. Virginia) AWS Region. To learn more, read the AWS News Blog, HAQM Nova Sonic product page, and HAQM Nova Sonic User Guide. To get started with the HAQM Nova Sonic in HAQM Bedrock, visit the HAQM Bedrock console.