I Built an AI VTuber From Scratch (Twitch Bot, Voice Cloning, 3D Avatar) | EnginSam Review

A full, honest review of EnginSam. An AI VTuber project built from scratch at RAM Software and Development.

Sam and Jack walk through every major piece of the stack, from the earliest days when EnginSam was just a command box
that Alex typed into, all the way to the 3D avatar work that is currently in progress.

This one is for fun. Alex has not yet decided whether EnginSam earns a spot on the RAM Software and Development
website as a feature, or whether it stays a passion project. If you have an opinion, drop it in the comments.

What we cover
- The original command box - a text input that just talked to Sam
- Chatterbox TTS voice cloning - Python FastAPI running locally
- The 2D puppet avatar - Three js, VRM, GLB, blink, breathe, mouth flap
- Mouth flapping with viseme targets - A I U E O shapes synced to speech
- Twitch chat bot monitoring - tmi js, priority queue for bits, moderation policy
- Three tier content filter - allow, review, block, fail closed
- The AI auto responder - pluggable Claude, OpenAI, Ollama backends
- Personality and memory - system prompt, knowledge base, 45 min per viewer memory
- The Electron desktop control app - 8 tabs, multi agent Command Center
- The 3D VTuber in progress - VRM and GLB avatars, 14 animation sliders, preset engine
- Honest rough edges and what still needs to ship

Stack: Node js, Electron, React, TypeScript, Python FastAPI, Chatterbox TTS, tmi js, Three js, VRM, PostgreSQL.

Chapters
00:00 A project reviews itself
01:00 The original command box
01:30 Voice and the 2D puppet
02:15 Mouth flapping and visemes
02:45 Twitch chat and the priority queue
03:15 Three tier moderation
04:00 The auto responder and fallback voice
04:30 Personality and memory
05:15 The Electron desktop app
06:00 Command Center and multi agent roster
06:30 3D VTuber status
07:15 Rough edges
08:00 Website feature or passion project
09:00 Closing thoughts

If you want to build something like this, the tools are all open source. Chatterbox for voice. Three js for the
avatar. tmi js for Twitch. An AI provider of your choosing. The hardest parts are taste and time.

Podcast by RAM Software and Development. Hosted by Sam (AI co host) and Jack (human co host).

#AIVtuber #TwitchBot #EnginSam #VoiceCloning #AIHosts #ThreeJs #TheCriticalCast #RAMSoftwareAndDevelopment
#ChatterboxTTS #IndieAI

Видео I Built an AI VTuber From Scratch (Twitch Bot, Voice Cloning, 3D Avatar) | EnginSam Review канала Alex