Unity Games Now Let You Talk to Characters Out Loud

Game developers using Unity, a popular game engine, can now add voice-controlled characters to their games with a new tool from ElevenLabs called ElevenAgents Unity SDK. This means when you play a game, you can walk up to a character, speak out loud, and the character will respond with a voice—just like talking to a person. The tool handles listening through your microphone and playing the character's voice through your speakers.

The best part is that it works across different platforms: in the Unity Editor, on desktop builds, and even in web browsers. Support for iOS, Android, and VR/XR is in beta. So whether you're playing on a computer or a phone, you can have natural voice conversations with game characters. This could make games more immersive and fun, especially for role-playing or adventure games.

However, there are some technical details. Each character needs an agent set up in the ElevenLabs dashboard, which includes the character's voice and personality prompt. Developers can use dynamic variables to give each character different moods or traits, and even let characters react to game events mid-conversation. The tool also allows characters to trigger game actions, like opening a door, through client tools. But before shipping a game, developers must enable authentication to protect their API key—never put it directly in the game build.

The SDK includes a sample project that takes about 10 minutes to set up, ending with a cube that greets you when you walk up. This shows how quickly developers can prototype voice interactions. While this is mainly for game developers, it hints at a future where talking to digital characters becomes as normal as typing. For players, it means more engaging games; for developers, it's a new way to bring characters to life.