ElevenLabs launches customizable Conversational AI with advanced telephony integration

ElevenLabs has introduced a new Conversational AI feature designed to create AI agents that offer low latency, scalability, and high configurability. The platform provides comprehensive speech processing capabilities, including Speech-to-Text, LLM integrations, Text-to-Speech, turn-taking, and interruption management, making it suitable for various applications, such as outbound sales dialers, scheduling assistants, interactive game characters, tutors, and customer support agents.

Customization is a significant aspect of this new feature, allowing users to adjust the knowledge base, system prompts, and voice settings. The platform's flexibility enables users to switch out LLMs whenever needed, ensuring access to the latest models or integrating personal LLMs for complete control. For more advanced users, personal servers for LLMs offer extensive configuration options.

Additionally, the system includes enhanced telephony features with Twilio integration for call management and tool-calling abilities for smooth interaction with external tools. Furthermore, the Voice Library now features "Collections," alongside the recently launched Custom Voice Design tool to help users create and choose voices for large-scale applications.