Real-Time AI Avatar Voice Agent with LiveKit and Runway Characters

See a real-time, lip-synced AI avatar speaking through a LiveKit voice agent, powered by the Runway Characters plugin and LiveKit Inference for STT, LLM, and TTS.

Sign up for LiveKit Cloud: https://cloud.livekit.io/signup?utm_source=youtube&utm_medium=video&utm_campaign=devrel&utm_content=ef5mRMdlS_o

The Runway Characters plugin renders a real-time intelligent avatar from a single reference image, with lip sync, eye movement, expressions, and gestures. The LiveKit Agents framework handles the conversational pipeline, so the only third-party credential involved is a Runway API secret. The avatar joins the LiveKit room as a secondary participant, and the React `useVoiceAssistant()` hook handles rendering on the frontend with no extra work.

Adding a Runway avatar to a LiveKit voice agent takes three lines of agent code, a `runway` plugin extra, and a Runway character (preset or custom). This video walks through what Runway Characters does, how the plugin slots into a LiveKit AgentSession, and the small code change that puts a face on a voice agent.

📚 Resources 📚
LiveKit Runway plugin guide → https://docs.livekit.io/agents/models/avatar/plugins/runway/?utm_source=youtube&utm_medium=video&utm_campaign=devrel&utm_content=ef5mRMdlS_o
LiveKit avatar pattern → https://docs.livekit.io/agents/models/avatar/?utm_source=youtube&utm_medium=video&utm_campaign=devrel&utm_content=ef5mRMdlS_o
Agent docs → https://docs.livekit.io/agents/?utm_source=youtube&utm_medium=video&utm_campaign=devrel&utm_content=ef5mRMdlS_o

🤝 Join the Community: https://community.livekit.io/?utm_source=youtube&utm_medium=video&utm_campaign=devrel&utm_content=ef5mRMdlS_o

#livekit #ai #voiceai

Видео Real-Time AI Avatar Voice Agent with LiveKit and Runway Characters канала LiveKit