Real-Time Live Microphone Lip Sync for MetaHuman for UE 5.6

This tutorial shows how to set up lightweight real-time microphone-based lip sync for MetaHumans created with the new MetaHuman Creator system introduced in Unreal Engine 5.6.

You'll learn how to connect live voice input to your MetaHuman's facial animation using the Runtime MetaHuman Lip Sync plugin.

Speak into your mic and watch your MetaHuman animate naturally in real time. Perfect for games, virtual production, livestreaming avatars, and interactive experiences.

This setup is powered by:
🔹 Runtime MetaHuman Lip Sync – for generating facial animation from audio (https://solutions.georgy.dev/runtime-metahuman-lip-sync)
🔹 Runtime Audio Importer – for capturing audio from the microphone at runtime (https://solutions.georgy.dev/runtime-audio-importer)

🎮 Test it on your device (Windows): https://georgy.dev/runtime-metahuman-lip-sync-demo-windows

🌐 Product website: https://solutions.georgy.dev/runtime-metahuman-lip-sync
🔗 Fab link: https://www.fab.com/listings/b514294e-e78b-4b8b-ad21-78ce51dc7e8c
📦 Download Demo source files (UE 5.5): https://georgy.dev/runtime-metahuman-lip-sync-demo-source (requires this plugin, along with Runtime Audio Importer and Runtime Text To Speech plugins, to be installed)
📘 Documentation: https://docs.georgy.dev/runtime-metahuman-lip-sync/overview/
💬 Join our Discord: https://georgy.dev/discord

Timecodes:
0:00 Verifying required plugins
0:19 Creating a MetaHuman using MetaHuman Creator (UE 5.6)
1:57 Adding the MetaHuman character to the scene
2:19 Setting up real-time microphone lip sync
4:21 Testing live microphone lip sync performance

#UnrealEngine #UE5 #MetaHuman #LipSync #GameDev #VirtualProduction #FacialAnimation

Видео Real-Time Live Microphone Lip Sync for MetaHuman for UE 5.6 канала Georgy Dev